Update README.md
Browse files
README.md
CHANGED
@@ -38,7 +38,7 @@ pipeline_tag: image-text-to-text
|
|
38 |
Deploy this FP8 quantized variant with vLLM using:
|
39 |
|
40 |
```
|
41 |
-
vllm serve RedHatAI/Mistral-Small-3.2-24B-Instruct-2506-FP8 --tokenizer_mode mistral --config_format mistral --load_format mistral --tool-call-parser mistral --enable-auto-tool-choice --limit_mm_per_prompt 'image=10
|
42 |
```
|
43 |
|
44 |
# Mistral-Small-3.2-24B-Instruct-2506
|
|
|
38 |
Deploy this FP8 quantized variant with vLLM using:
|
39 |
|
40 |
```
|
41 |
+
vllm serve RedHatAI/Mistral-Small-3.2-24B-Instruct-2506-FP8 --tokenizer_mode mistral --config_format mistral --load_format mistral --tool-call-parser mistral --enable-auto-tool-choice --limit_mm_per_prompt 'image=10'
|
42 |
```
|
43 |
|
44 |
# Mistral-Small-3.2-24B-Instruct-2506
|