alexmarques commited on
Commit
b1f6249
·
verified ·
1 Parent(s): f33c6f8

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -121,7 +121,7 @@ The model was evaluated on the [OpenLLM](https://huggingface.co/spaces/open-llm-
121
  ```
122
  lm_eval \
123
  --model vllm \
124
- --model_args pretrained="neuralmagic/Qwen2.5-7B-FP8-dynamic",dtype=auto,gpu_memory_utilization=0.5,max_model_len=4096,enable_chunk_prefill=True,tensor_parallel_size=1 \
125
  --apply_chat_template \
126
  --fewshot_as_multiturn \
127
  --tasks openllm \
 
121
  ```
122
  lm_eval \
123
  --model vllm \
124
+ --model_args pretrained="neuralmagic/Qwen2.5-7B-Instruct-FP8-dynamic",dtype=auto,gpu_memory_utilization=0.5,max_model_len=4096,enable_chunk_prefill=True,tensor_parallel_size=1 \
125
  --apply_chat_template \
126
  --fewshot_as_multiturn \
127
  --tasks openllm \