Quantized MTP head of Deepseek R1. For use with the Unsloth's Q4_K quants.
Llama.cpp does not support MTP heads, but vLLM does.
- Downloads last month
- 100
Hardware compatibility
Log In to add your hardware
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for pdelobelle/DeepSeek-R1-GGUF-MTP
Base model
deepseek-ai/DeepSeek-R1