Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

17

Base only

Active filters: Llama-cpp

prithivMLmods/Qwen2.5-0.5B-200K-GGUF

Text Generation • 0.5B • Updated Nov 8, 2024 • 294 • 5

prithivMLmods/Qwen2.5-0.5B-200K

Text Generation • Updated Nov 8, 2024 • 29 • • 1

prithivMLmods/Qwen2.5-Coder-7B-Instruct-GGUF

Text Generation • 8B • Updated Nov 12, 2024 • 679 • 2

prithivMLmods/Qwen2.5-Coder-7B-GGUF

Text Generation • 8B • Updated Nov 12, 2024 • 494 • 3

prithivMLmods/Qwen2.5-Coder-3B-GGUF

Text Generation • 3B • Updated Nov 12, 2024 • 188 • 4

prithivMLmods/Qwen2.5-Coder-1.5B-GGUF

Text Generation • 2B • Updated Nov 12, 2024 • 875 • 5

prithivMLmods/Qwen2.5-Coder-1.5B-Instruct-GGUF

Text Generation • 2B • Updated Nov 18, 2024 • 239 • 3

prithivMLmods/Qwen2.5-Coder-3B-Instruct-GGUF

Text Generation • 3B • Updated Nov 13, 2024 • 210 • 5

prithivMLmods/Llama-3.2-3B-GGUF

Text Generation • 3B • Updated Nov 18, 2024 • 183 • 2

prithivMLmods/Llama-3.2-3B-Instruct-GGUF

Text Generation • 3B • Updated Nov 15, 2024 • 79 • 2

prithivMLmods/Qwen2.5-Coder-14B-Instruct-F16-GGUF

Text Generation • 15B • Updated Nov 19, 2024 • 218 • 2

prithivMLmods/Acrux-500M-o1-Journey-GGUF

Text Generation • 0.5B • Updated Dec 7, 2024 • 151 • 3

prithivMLmods/Qwen-UMLS-7B-Instruct-GGUF

Text Generation • 8B • Updated Dec 9, 2024 • 53 • 2

mradermacher/Qwen2.5-0.5B-200K-GGUF

0.5B • Updated Feb 10, 2025 • 34

mradermacher/Qwen2.5-0.5B-200K-i1-GGUF

0.5B • Updated Feb 10, 2025 • 14

michelkao/Ollama-3.2-GGUF

Text Generation • 3B • Updated May 6, 2025 • 343

Terminator278/Qwen2.5-Coder-3B-GGUF

Text Generation • 3B • Updated Jun 14 • 220