Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

96

Base only

Active filters: localai

mudler/depth-anything.cpp-gguf

Depth Estimation • 0.1B • Updated 9 days ago • 2.85k • 6

mudler/locate-anything.cpp-gguf

Object Detection • 4B • Updated 18 days ago • 2.92k • 6

mudler/Qwen3.6-27B-NVFP4-GGUF

Text Generation • 27B • Updated 2 days ago • 711 • 1

mudler/Qwen3.6-35B-A3B-NVFP4-GGUF

Text Generation • 36B • Updated 2 days ago • 817 • 1

chris365312/whisper-large-v3-de-at-ct2

Automatic Speech Recognition • Updated Jun 24, 2025 • 13 • 3

AbdulElahGwaith/LocalAI

DQN-Labs-Community/dqnMath-v1

Text Generation • 4B • Updated Apr 1 • 26 • • 2

DQN-Labs-Community/dqnMath-v1-GGUF

Text Generation • 4B • Updated Apr 1 • 19 • 2

DQN-Labs-Community/dqnCode-v1

Text Generation • 4B • Updated Mar 30 • 42 • 2

DQN-Labs-Community/dqnCode-v1-GGUF

Text Generation • 4B • Updated Apr 1 • 601 • 2

DQN-Labs-Community/dqnGPT-v1

Text Generation • 8B • Updated Apr 6 • 9 • 1

mradermacher/dqnGPT-v1-GGUF

8B • Updated Apr 4 • 61 • 1

DQN-Labs-Community/dqnGPT-v1-GGUF

Text Generation • 8B • Updated Apr 5 • 111 • 2

mradermacher/dqnMath-v1-GGUF

4B • Updated Apr 7 • 67 • 1

mradermacher/dqnMath-v1-i1-GGUF

4B • Updated Apr 7 • 115 • 1

DQN-Labs-Community/dqnScience-v1-GGUF

Text Generation • 4B • Updated Apr 7 • 67 • 1

LocalAI-io/whisper-tiny-it

Automatic Speech Recognition • 37.8M • Updated May 24 • 11

LocalAI-io/whisper-tiny-it-ct2-int8

Automatic Speech Recognition • Updated May 24 • 7

LocalAI-io/whisper-base-it

Automatic Speech Recognition • 72.6M • Updated May 24 • 4

LocalAI-io/whisper-base-it-ct2-int8

Automatic Speech Recognition • Updated May 24 • 13

LocalAI-io/whisper-tiny-it-multi

Automatic Speech Recognition • 37.8M • Updated May 24 • 5

LocalAI-io/whisper-tiny-it-multi-ct2-int8

Automatic Speech Recognition • Updated May 24 • 14

LocalAI-io/whisper-base-it-multi

Automatic Speech Recognition • 72.6M • Updated May 24 • 4

LocalAI-io/whisper-base-it-multi-ct2-int8

Automatic Speech Recognition • Updated May 24 • 8

LocalAI-io/whisper-small-it-multi

Automatic Speech Recognition • 0.2B • Updated May 24 • 3

LocalAI-io/whisper-small-it-multi-ct2-int8

Automatic Speech Recognition • Updated May 24 • 11

LocalAI-io/whisper-medium-it-multi

Automatic Speech Recognition • 0.8B • Updated May 24 • 2

LocalAI-io/whisper-medium-it-multi-ct2-int8

Automatic Speech Recognition • Updated May 24 • 8

LocalAI-io/whisper-small-it

Automatic Speech Recognition • 0.2B • Updated May 24 • 2

LocalAI-io/whisper-small-it-ct2-int8

Automatic Speech Recognition • Updated May 24 • 7