New 2.0 version of our Dynamic GGUF + Quants. Dynamic 2.0 achieves superior accuracy & SOTA quantization performance.
AI & ML interests
Open Source AI 💚
Recent Activity
View all activity
Qwen's new Qwen3 models. In Unsloth Dynamic 2.0, GGUF, 4-bit and 16-bit Safetensor formats. Includes 128K Context Length variants.
All versions of Google's new multimodal models including QAT in 1B, 4B, 12B, and 27B sizes. In GGUF, dynamic 4-bit and 16-bit formats.
-
unsloth/gemma-3-270m-it-GGUF
Text Generation • 0.3B • Updated • 54.5k • 97 -
unsloth/gemma-3-270m-it-qat-GGUF
Text Generation • 0.3B • Updated • 13.9k • 8 -
unsloth/gemma-3-270m-it
Text Generation • 0.3B • Updated • 49.4k • 12 -
unsloth/gemma-3-270m-it-unsloth-bnb-4bit
Text Generation • 0.2B • Updated • 21k • 1
Google Gemma 3n models, all versions including Dynamic GGUF, 4-bit, 16-bit and formats!
-
unsloth/gemma-3n-E4B-it-GGUF
Image-Text-to-Text • 7B • Updated • 71.5k • 156 -
unsloth/gemma-3n-E2B-it-GGUF
Image-Text-to-Text • 4B • Updated • 27.9k • 38 -
unsloth/gemma-3n-E4B-it-unsloth-bnb-4bit
Image-Text-to-Text • 8B • Updated • 65.4k • 8 -
unsloth/gemma-3n-E4B-unsloth-bnb-4bit
Image-Text-to-Text • 8B • Updated • 6.43k • 4
Microsoft's Phi-4 models including Reasoning + Reasoning Plus & mini. Includes Dynamic 2.0 GGUF, 4-bit & 16-bit versions. Includes Unsloth's bug fixes
Unsloths Dynamic 4bit Quants selectively skips quantizing certain parameters; greatly improving accuracy while only using <10% more VRAM than BnB 4bit
-
unsloth/DeepSeek-R1-Distill-Llama-8B-unsloth-bnb-4bit
Text Generation • 5B • Updated • 33.6k • 32 -
unsloth/DeepSeek-R1-Distill-Qwen-14B-unsloth-bnb-4bit
Text Generation • 10B • Updated • 3.16k • 29 -
unsloth/DeepSeek-R1-Distill-Qwen-7B-unsloth-bnb-4bit
Text Generation • 5B • Updated • 12.6k • 23 -
unsloth/gemma-3-12b-it-unsloth-bnb-4bit
Image-Text-to-Text • 8B • Updated • 37k • 20
A collection of 4-bit, Dynamic 4-bit and 16-bit voice models including Sesame-CSM, OpenAI's Whisper, Orpheus. Fine-tune them with Unsloth now!
A collection of Mistral's new Small 3.2 and 3 models including GGUF, 4-bit and more!
-
unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF
Image-Text-to-Text • 24B • Updated • 39.2k • 95 -
unsloth/Mistral-Small-3.2-24B-Instruct-2506
Image-Text-to-Text • 24B • Updated • 13.6k • • 4 -
unsloth/Mistral-Small-3.2-24B-Instruct-2506-FP8
Image-Text-to-Text • Updated • 65 • 3 -
unsloth/Mistral-Small-3.2-24B-Instruct-2506-unsloth-bnb-4bit
Image-Text-to-Text • 13B • Updated • 11.2k • 7
Meta's new Llama 3.3 (70B) model in all formats. Includes GGUF, 4-bit bnb and original versions.
Qwen's reasoning models including QwQ (32B) & QVQ (72B) in formats: GGUF, dynamic 4-bit and 16-bit original versions.
Meta's Llama 3.2 vision models 11B and 90B. Include 4-bit bnb and original versions.
-
unsloth/Llama-3.2-11B-Vision-Instruct
Image-to-Text • 11B • Updated • 13.2k • 84 -
unsloth/Llama-3.2-11B-Vision-Instruct-bnb-4bit
Image-to-Text • 6B • Updated • 12.5k • 77 -
unsloth/Llama-3.2-11B-Vision
Image-to-Text • 11B • Updated • 1.2k • 33 -
unsloth/Llama-3.2-11B-Vision-bnb-4bit
Image-to-Text • 6B • Updated • 1.54k • 16
Meta's Llama 3.1 models including 8B, 70B, 405B. Includes 4-bit bnb and original versions.
-
unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit
Text Generation • 5B • Updated • 626k • 81 -
unsloth/Llama-3.1-8B-Instruct-unsloth-bnb-4bit
Text Generation • 5B • Updated • 23.7k • 4 -
unsloth/Meta-Llama-3.1-8B-Instruct-unsloth-bnb-4bit
Text Generation • 5B • Updated • 41.7k • 4 -
unsloth/Meta-Llama-3.1-8B-bnb-4bit
Text Generation • 5B • Updated • 24.9k • 102
Native bitsandbytes 4bit pre quantized models
-
unsloth/Llama-3.2-3B-bnb-4bit
Text Generation • 2B • Updated • 15k • 18 -
unsloth/Meta-Llama-3.1-8B-bnb-4bit
Text Generation • 5B • Updated • 24.9k • 102 -
unsloth/llama-3-8b-Instruct-bnb-4bit
Text Generation • 5B • Updated • 47.8k • 134 -
unsloth/gemma-2-9b-bnb-4bit
Text Generation • 5B • Updated • 7.18k • 30
OpenAI's gpt-oss-20b and gpt-oss-120b is here! The powerful open models are available in GGUF, original & 4-bit formats.
-
unsloth/gpt-oss-20b-GGUF
Text Generation • 21B • Updated • 637k • 332 -
unsloth/gpt-oss-120b-GGUF
Text Generation • 117B • Updated • 199k • 123 -
unsloth/gpt-oss-20b-unsloth-bnb-4bit
Text Generation • 21B • Updated • 108k • 18 -
unsloth/gpt-oss-120b-unsloth-bnb-4bit
Text Generation • 117B • Updated • 61.4k • 6
DeepSeek's new 3.1 update to their V3 models!
DeepSeek-R1-0528 is here! The most powerful reasoning open LLM, available in GGUF, original & 4-bit formats. Includes Llama & Qwen distilled models.
-
unsloth/DeepSeek-R1-0528-GGUF
Text Generation • 671B • Updated • 45.3k • 188 -
unsloth/DeepSeek-R1-0528-Qwen3-8B-GGUF
Text Generation • 8B • Updated • 279k • 294 -
unsloth/DeepSeek-R1-0528-Qwen3-8B-unsloth-bnb-4bit
Text Generation • 5B • Updated • 21.3k • 11 -
unsloth/DeepSeek-R1-0528
Text Generation • 685B • Updated • 1.68k • 15
Meta's new Llama 4 multimodal models, Scout & Maverick. Includes Dynamic GGUFs, 16-bit & Dynamic 4-bit uploads. Run & fine-tune them with Unsloth!
-
unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF
Image-Text-to-Text • 108B • Updated • 64k • 110 -
unsloth/Llama-4-Maverick-17B-128E-Instruct-GGUF
Image-Text-to-Text • 401B • Updated • 16.2k • 34 -
unsloth/Llama-4-Scout-17B-16E-Instruct
Image-Text-to-Text • 109B • Updated • 3.6k • 54 -
unsloth/Llama-4-Scout-17B-16E-Instruct-unsloth-bnb-4bit
Image-Text-to-Text • 57B • Updated • 3.74k • 80
The Qwen3-Coder models deliver SOTA advancements in agentic coding and code tasks. Includes Qwen3-Coder-480B-A35B.
-
unsloth/Qwen3-Coder-30B-A3B-Instruct-GGUF
Text Generation • 31B • Updated • 277k • 190 -
unsloth/Qwen3-Coder-30B-A3B-Instruct-1M-GGUF
Text Generation • 0.0B • Updated • 58.9k • 95 -
unsloth/Qwen3-Coder-480B-A35B-Instruct-GGUF
Text Generation • 480B • Updated • 67.8k • 149 -
unsloth/Qwen3-Coder-480B-A35B-Instruct-1M-GGUF
Text Generation • 480B • Updated • 6.43k • 39
Deepseek-V3-0324 and V3 - available in original, and Dynamic GGUF formats, with support for 2-8-bit quantized versions.
Find GGUFs and other variants of diffusion based and Black Forest Lab's FLUX models.
Meta's new Llama 3.2 vision and text models including 1B, 3B, 11B and 90B. Includes GGUF, 4-bit bnb and original versions.
-
unsloth/Llama-3.2-1B-Instruct-GGUF
Text Generation • 1B • Updated • 33.1k • 41 -
unsloth/Llama-3.2-1B-Instruct
Text Generation • 1B • Updated • 74.9k • 78 -
unsloth/Llama-3.2-1B-Instruct-unsloth-bnb-4bit
Text Generation • 0.8B • Updated • 44.2k • 3 -
unsloth/Llama-3.2-1B-Instruct-bnb-4bit
Text Generation • 0.8B • Updated • 15.9k • 17
All versions of Qwen2.5-VL including the new 32B version and 4-bit, 16-bit and more!
-
unsloth/Qwen2.5-VL-3B-Instruct-GGUF
Image-Text-to-Text • 3B • Updated • 7.83k • 9 -
unsloth/Qwen2.5-VL-7B-Instruct-GGUF
Image-Text-to-Text • 8B • Updated • 65.6k • 45 -
unsloth/Qwen2.5-VL-32B-Instruct-GGUF
Image-Text-to-Text • 33B • Updated • 4.62k • 4 -
unsloth/Qwen2.5-VL-72B-Instruct-GGUF
Image-Text-to-Text • 73B • Updated • 5.89k • 6
Collection of the most popular vision models including Llama 3.2, LlaVa, Qwen2 VL, Pixtral, PaliGemma and more!
-
unsloth/Llama-3.2-11B-Vision-Instruct
Image-to-Text • 11B • Updated • 13.2k • 84 -
unsloth/Llama-3.2-11B-Vision-Instruct-bnb-4bit
Image-to-Text • 6B • Updated • 12.5k • 77 -
unsloth/Llama-3.2-11B-Vision-Instruct-unsloth-bnb-4bit
Image-to-Text • 6B • Updated • 43.9k • 28 -
unsloth/Qwen2-VL-7B-Instruct-bnb-4bit
Image-Text-to-Text • 5B • Updated • 3.86k • 6
Complete collection of Code-specific model series for Qwen2.5 in bnb 4bit, 16bit and GGUF formats.
-
unsloth/Llama-3.2-3B-Instruct-bnb-4bit
Text Generation • 2B • Updated • 34.9k • 27 -
unsloth/Llama-3.2-1B-Instruct-bnb-4bit
Text Generation • 0.8B • Updated • 15.9k • 17 -
unsloth/Llama-3.2-11B-Vision-Instruct-bnb-4bit
Image-to-Text • 6B • Updated • 12.5k • 77 -
unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit
Text Generation • 5B • Updated • 626k • 81
New 2.0 version of our Dynamic GGUF + Quants. Dynamic 2.0 achieves superior accuracy & SOTA quantization performance.
OpenAI's gpt-oss-20b and gpt-oss-120b is here! The powerful open models are available in GGUF, original & 4-bit formats.
-
unsloth/gpt-oss-20b-GGUF
Text Generation • 21B • Updated • 637k • 332 -
unsloth/gpt-oss-120b-GGUF
Text Generation • 117B • Updated • 199k • 123 -
unsloth/gpt-oss-20b-unsloth-bnb-4bit
Text Generation • 21B • Updated • 108k • 18 -
unsloth/gpt-oss-120b-unsloth-bnb-4bit
Text Generation • 117B • Updated • 61.4k • 6
Qwen's new Qwen3 models. In Unsloth Dynamic 2.0, GGUF, 4-bit and 16-bit Safetensor formats. Includes 128K Context Length variants.
DeepSeek's new 3.1 update to their V3 models!
All versions of Google's new multimodal models including QAT in 1B, 4B, 12B, and 27B sizes. In GGUF, dynamic 4-bit and 16-bit formats.
-
unsloth/gemma-3-270m-it-GGUF
Text Generation • 0.3B • Updated • 54.5k • 97 -
unsloth/gemma-3-270m-it-qat-GGUF
Text Generation • 0.3B • Updated • 13.9k • 8 -
unsloth/gemma-3-270m-it
Text Generation • 0.3B • Updated • 49.4k • 12 -
unsloth/gemma-3-270m-it-unsloth-bnb-4bit
Text Generation • 0.2B • Updated • 21k • 1
DeepSeek-R1-0528 is here! The most powerful reasoning open LLM, available in GGUF, original & 4-bit formats. Includes Llama & Qwen distilled models.
-
unsloth/DeepSeek-R1-0528-GGUF
Text Generation • 671B • Updated • 45.3k • 188 -
unsloth/DeepSeek-R1-0528-Qwen3-8B-GGUF
Text Generation • 8B • Updated • 279k • 294 -
unsloth/DeepSeek-R1-0528-Qwen3-8B-unsloth-bnb-4bit
Text Generation • 5B • Updated • 21.3k • 11 -
unsloth/DeepSeek-R1-0528
Text Generation • 685B • Updated • 1.68k • 15
Google Gemma 3n models, all versions including Dynamic GGUF, 4-bit, 16-bit and formats!
-
unsloth/gemma-3n-E4B-it-GGUF
Image-Text-to-Text • 7B • Updated • 71.5k • 156 -
unsloth/gemma-3n-E2B-it-GGUF
Image-Text-to-Text • 4B • Updated • 27.9k • 38 -
unsloth/gemma-3n-E4B-it-unsloth-bnb-4bit
Image-Text-to-Text • 8B • Updated • 65.4k • 8 -
unsloth/gemma-3n-E4B-unsloth-bnb-4bit
Image-Text-to-Text • 8B • Updated • 6.43k • 4
Meta's new Llama 4 multimodal models, Scout & Maverick. Includes Dynamic GGUFs, 16-bit & Dynamic 4-bit uploads. Run & fine-tune them with Unsloth!
-
unsloth/Llama-4-Scout-17B-16E-Instruct-GGUF
Image-Text-to-Text • 108B • Updated • 64k • 110 -
unsloth/Llama-4-Maverick-17B-128E-Instruct-GGUF
Image-Text-to-Text • 401B • Updated • 16.2k • 34 -
unsloth/Llama-4-Scout-17B-16E-Instruct
Image-Text-to-Text • 109B • Updated • 3.6k • 54 -
unsloth/Llama-4-Scout-17B-16E-Instruct-unsloth-bnb-4bit
Image-Text-to-Text • 57B • Updated • 3.74k • 80
Microsoft's Phi-4 models including Reasoning + Reasoning Plus & mini. Includes Dynamic 2.0 GGUF, 4-bit & 16-bit versions. Includes Unsloth's bug fixes
The Qwen3-Coder models deliver SOTA advancements in agentic coding and code tasks. Includes Qwen3-Coder-480B-A35B.
-
unsloth/Qwen3-Coder-30B-A3B-Instruct-GGUF
Text Generation • 31B • Updated • 277k • 190 -
unsloth/Qwen3-Coder-30B-A3B-Instruct-1M-GGUF
Text Generation • 0.0B • Updated • 58.9k • 95 -
unsloth/Qwen3-Coder-480B-A35B-Instruct-GGUF
Text Generation • 480B • Updated • 67.8k • 149 -
unsloth/Qwen3-Coder-480B-A35B-Instruct-1M-GGUF
Text Generation • 480B • Updated • 6.43k • 39
Unsloths Dynamic 4bit Quants selectively skips quantizing certain parameters; greatly improving accuracy while only using <10% more VRAM than BnB 4bit
-
unsloth/DeepSeek-R1-Distill-Llama-8B-unsloth-bnb-4bit
Text Generation • 5B • Updated • 33.6k • 32 -
unsloth/DeepSeek-R1-Distill-Qwen-14B-unsloth-bnb-4bit
Text Generation • 10B • Updated • 3.16k • 29 -
unsloth/DeepSeek-R1-Distill-Qwen-7B-unsloth-bnb-4bit
Text Generation • 5B • Updated • 12.6k • 23 -
unsloth/gemma-3-12b-it-unsloth-bnb-4bit
Image-Text-to-Text • 8B • Updated • 37k • 20
Deepseek-V3-0324 and V3 - available in original, and Dynamic GGUF formats, with support for 2-8-bit quantized versions.
A collection of 4-bit, Dynamic 4-bit and 16-bit voice models including Sesame-CSM, OpenAI's Whisper, Orpheus. Fine-tune them with Unsloth now!
Find GGUFs and other variants of diffusion based and Black Forest Lab's FLUX models.
A collection of Mistral's new Small 3.2 and 3 models including GGUF, 4-bit and more!
-
unsloth/Mistral-Small-3.2-24B-Instruct-2506-GGUF
Image-Text-to-Text • 24B • Updated • 39.2k • 95 -
unsloth/Mistral-Small-3.2-24B-Instruct-2506
Image-Text-to-Text • 24B • Updated • 13.6k • • 4 -
unsloth/Mistral-Small-3.2-24B-Instruct-2506-FP8
Image-Text-to-Text • Updated • 65 • 3 -
unsloth/Mistral-Small-3.2-24B-Instruct-2506-unsloth-bnb-4bit
Image-Text-to-Text • 13B • Updated • 11.2k • 7
Meta's new Llama 3.2 vision and text models including 1B, 3B, 11B and 90B. Includes GGUF, 4-bit bnb and original versions.
-
unsloth/Llama-3.2-1B-Instruct-GGUF
Text Generation • 1B • Updated • 33.1k • 41 -
unsloth/Llama-3.2-1B-Instruct
Text Generation • 1B • Updated • 74.9k • 78 -
unsloth/Llama-3.2-1B-Instruct-unsloth-bnb-4bit
Text Generation • 0.8B • Updated • 44.2k • 3 -
unsloth/Llama-3.2-1B-Instruct-bnb-4bit
Text Generation • 0.8B • Updated • 15.9k • 17
Meta's new Llama 3.3 (70B) model in all formats. Includes GGUF, 4-bit bnb and original versions.
All versions of Qwen2.5-VL including the new 32B version and 4-bit, 16-bit and more!
-
unsloth/Qwen2.5-VL-3B-Instruct-GGUF
Image-Text-to-Text • 3B • Updated • 7.83k • 9 -
unsloth/Qwen2.5-VL-7B-Instruct-GGUF
Image-Text-to-Text • 8B • Updated • 65.6k • 45 -
unsloth/Qwen2.5-VL-32B-Instruct-GGUF
Image-Text-to-Text • 33B • Updated • 4.62k • 4 -
unsloth/Qwen2.5-VL-72B-Instruct-GGUF
Image-Text-to-Text • 73B • Updated • 5.89k • 6
Qwen's reasoning models including QwQ (32B) & QVQ (72B) in formats: GGUF, dynamic 4-bit and 16-bit original versions.
Collection of the most popular vision models including Llama 3.2, LlaVa, Qwen2 VL, Pixtral, PaliGemma and more!
-
unsloth/Llama-3.2-11B-Vision-Instruct
Image-to-Text • 11B • Updated • 13.2k • 84 -
unsloth/Llama-3.2-11B-Vision-Instruct-bnb-4bit
Image-to-Text • 6B • Updated • 12.5k • 77 -
unsloth/Llama-3.2-11B-Vision-Instruct-unsloth-bnb-4bit
Image-to-Text • 6B • Updated • 43.9k • 28 -
unsloth/Qwen2-VL-7B-Instruct-bnb-4bit
Image-Text-to-Text • 5B • Updated • 3.86k • 6
Meta's Llama 3.2 vision models 11B and 90B. Include 4-bit bnb and original versions.
-
unsloth/Llama-3.2-11B-Vision-Instruct
Image-to-Text • 11B • Updated • 13.2k • 84 -
unsloth/Llama-3.2-11B-Vision-Instruct-bnb-4bit
Image-to-Text • 6B • Updated • 12.5k • 77 -
unsloth/Llama-3.2-11B-Vision
Image-to-Text • 11B • Updated • 1.2k • 33 -
unsloth/Llama-3.2-11B-Vision-bnb-4bit
Image-to-Text • 6B • Updated • 1.54k • 16
Complete collection of Code-specific model series for Qwen2.5 in bnb 4bit, 16bit and GGUF formats.
Meta's Llama 3.1 models including 8B, 70B, 405B. Includes 4-bit bnb and original versions.
-
unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit
Text Generation • 5B • Updated • 626k • 81 -
unsloth/Llama-3.1-8B-Instruct-unsloth-bnb-4bit
Text Generation • 5B • Updated • 23.7k • 4 -
unsloth/Meta-Llama-3.1-8B-Instruct-unsloth-bnb-4bit
Text Generation • 5B • Updated • 41.7k • 4 -
unsloth/Meta-Llama-3.1-8B-bnb-4bit
Text Generation • 5B • Updated • 24.9k • 102
Native bitsandbytes 4bit pre quantized models
-
unsloth/Llama-3.2-3B-bnb-4bit
Text Generation • 2B • Updated • 15k • 18 -
unsloth/Meta-Llama-3.1-8B-bnb-4bit
Text Generation • 5B • Updated • 24.9k • 102 -
unsloth/llama-3-8b-Instruct-bnb-4bit
Text Generation • 5B • Updated • 47.8k • 134 -
unsloth/gemma-2-9b-bnb-4bit
Text Generation • 5B • Updated • 7.18k • 30
-
unsloth/Llama-3.2-3B-Instruct-bnb-4bit
Text Generation • 2B • Updated • 34.9k • 27 -
unsloth/Llama-3.2-1B-Instruct-bnb-4bit
Text Generation • 0.8B • Updated • 15.9k • 17 -
unsloth/Llama-3.2-11B-Vision-Instruct-bnb-4bit
Image-to-Text • 6B • Updated • 12.5k • 77 -
unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit
Text Generation • 5B • Updated • 626k • 81