Gemma 3
Collection
4 items
•
Updated
•
17
Multimodal GGUFs
Vision and audio models compatible with llama-server and llama-mtmd-cli
-
-
ggml-org/Mistral-Small-3.1-24B-Instruct-2503-GGUF
Image-Text-to-Text • 24B • Updated • 394 • 4 -
ggml-org/moondream2-20250414-GGUF
0.5B • Updated • 2.68k • 3
ggml-org/pixtral-12b-GGUF
12B • Updated • 614 • 4Note . ------------ Below are audio models
-
ggml-org/ultravox-v0_5-llama-3_2-1b-GGUF
Audio-Text-to-Text • 1B • Updated • 847 • 4
ggml-org/ultravox-v0_5-llama-3_1-8b-GGUF
8B • Updated • 266 • 3Note . ------------ Below are vision+audio models
-
ggml-org/Qwen2.5-Omni-3B-GGUF
Any-to-Any • 3B • Updated • 4.07k • 9 -
ggml-org/Qwen2.5-Omni-7B-GGUF
Any-to-Any • 8B • Updated • 2.18k • 14 -
ggml-org/Voxtral-Mini-3B-2507-GGUF
4B • Updated • 2.45k • 2