Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

95

Base only

Active filters: mla

avlp12/Kimi-K2.7-Code-Alis-MLX-Dynamic-3.6bpw

Text Generation • 1T • Updated 6 days ago • 441 • 2

avlp12/Kimi-K2.7-Code-Alis-MLX-Dynamic-3.6bpw-VLM

Image-Text-to-Text • 1T • Updated 6 days ago • 593 • 2

InquiringMinds-AI/LongCat-Flash-Lite-GGUF

Text Generation • 69B • Updated Mar 3 • 1.27k • 8

mudler/GLM-4.7-Flash-APEX-GGUF

30B • Updated Apr 27 • 1.72k • 12

ubergarm/Kimi-K2.6-GGUF

Text Generation • 1T • Updated Apr 27 • 593 • 38

espnet/xeus

Automatic Speech Recognition • Updated Jun 17, 2025 • 49 • 150

bird-of-paradise/deepseek-mla

Text Generation • Updated Feb 27, 2025 • 20

BarraHome/llama3.2-1b-mla

1B • Updated Feb 24, 2025 • 7 • 4

erax-ai/EraX-LLaMA3.1-8B-DeepSeekR1-MLA-MoE-Raw

Text Generation • 13B • Updated Mar 10, 2025 • 8 • 15

Khawn2u/llama3.2-1b-mla-Q4_K_M-GGUF

1B • Updated Mar 10, 2025 • 4

ubergarm/DeepSeek-V3-0324-GGUF

Text Generation • 672B • Updated Jul 10, 2025 • 147 • 36

ubergarm/DeepSeek-R1T-Chimera-GGUF

Text Generation • Updated Jul 10, 2025 • 1

ubergarm/DeepSeek-R1-0528-GGUF

Text Generation • Updated Jul 19, 2025 • 366 • 50

anikifoss/DeepSeek-R1-0528-DQ4_K_R4

Text Generation • 672B • Updated Nov 27, 2025 • 14 • 9

LipingWang/spaCy-NER-MLA-Citations

Updated Jun 4, 2025

ubergarm/DeepSeek-TNG-R1T2-Chimera-GGUF

Text Generation • Updated Jul 11, 2025 • 34 • 6

ubergarm/Kimi-K2-Instruct-GGUF

Text Generation • 1T • Updated Jul 22, 2025 • 310 • 22

anikifoss/Kimi-K2-Instruct-DQ4_K

Text Generation • 1T • Updated Nov 27, 2025 • 12 • 4

tachyphylaxis/DeepSeek-R1-0528-GGUF

Text Generation • 672B • Updated Jul 18, 2025 • 13

gghfez/DeepSeek-V3-0324-IQ3_KS

Text Generation • 672B • Updated Jul 26, 2025 • 21 • 2

gghfez/DeepSeek-R1-Zero-IQ2_KS

Text Generation • 672B • Updated Oct 19, 2025 • 13

gghfez/DeepSeek-R1-Zero-IQ3_KS

Text Generation • 672B • Updated Oct 19, 2025 • 9

gghfez/DeepSeek-V3-0324-IQ2_KS

Text Generation • 672B • Updated Oct 18, 2025 • 10

gghfez/DeepSeek-V3.1-IQ2_KS

Text Generation • 672B • Updated Aug 22, 2025 • 6

ubergarm/DeepSeek-V3.1-GGUF

Text Generation • Updated Aug 24, 2025 • 337 • 15

anikifoss/DeepSeek-V3.1-HQ4_K

Text Generation • 671B • Updated Nov 27, 2025 • 3 • 2

ChrisMcCormick/deepseek-tiny-v0.1

Text Generation • 17.1M • Updated Sep 3, 2025 • 15 • 3

ChrisMcCormick/deepseek-tiny-mla-o-v0.1

Text Generation • 17M • Updated Sep 3, 2025 • 8 • 1

ubergarm/Kimi-K2-Instruct-0905-GGUF

Text Generation • Updated Sep 8, 2025 • 144 • 16

anikifoss/Kimi-K2-Instruct-0905-HQ4_K

Text Generation • 1T • Updated Nov 27, 2025 • 4 • 3