Edit Models filters

Model Tree

google/gemma-2-2b-it

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

185

Base only

Active filters: google/gemma-2-2b-it

google/gemma-2-2b-it-GGUF

3B • Updated Aug 27, 2024 • 152 • 92

Fizzarolli/gemma-2-2b-it-Q8_0-GGUF

Text Generation • 3B • Updated Jul 31, 2024 • 11

kaetemi/gemma-2-2b-it-Q4_0-GGUF

Text Generation • 3B • Updated Jul 31, 2024 • 38

Wusul/gemma-2-2b-it-Q8_0-GGUF

Text Generation • Updated Jul 31, 2024 • 17

bartowski/gemma-2-2b-it-GGUF

Text Generation • 3B • Updated Aug 5, 2024 • 234k • 100

BafS/gemma-2-2b-it-Q4_K_M-GGUF

Text Generation • 3B • Updated Jul 31, 2024 • 1.91k • 6

lmstudio-community/gemma-2-2b-it-GGUF

Text Generation • 3B • Updated Jul 31, 2024 • 5.85k • 22

legraphista/gemma-2-2b-it-IMat-GGUF

Text Generation • 3B • Updated Jul 31, 2024 • 1.08k • 2

newsletter/gemma-2-2b-it-Q6_K-GGUF

Text Generation • 3B • Updated Jul 31, 2024 • 89

roshanai/gemma-2-2b-it-Q6_K-GGUF

Text Generation • 3B • Updated Jul 31, 2024 • 81 • 2

mlc-ai/gemma-2-2b-it-q0f32-MLC

Updated Sep 7, 2025

mlc-ai/gemma-2-2b-it-q4f16_1-MLC

Updated Sep 7, 2025 • 8.68k • 6

mlc-ai/gemma-2-2b-it-q4f32_1-MLC

Updated Sep 7, 2025 • 397

mlc-ai/gemma-2-2b-it-q0f16-MLC

Updated Sep 7, 2025

NikolayKozloff/gemma-2-2b-it-Q8_0-GGUF

Text Generation • 3B • Updated Jul 31, 2024 • 11 • 1

ac3xx/gemma-2-2b-it-Q4_K_M-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 26

ac3xx/gemma-2-2b-it-Q6_K-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 7

Kondara/gemma-2-2b-it-Q8_0-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 4

Kondara/gemma-2-2b-it-Q4_K_M-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 17

ironlanderl/gemma-2-2b-it-Q5_K_M-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 39

polyverse/gemma-2-2b-it-Q4_K_M-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 294

second-state/gemma-2-2b-it-GGUF

Text Generation • 3B • Updated Aug 6, 2024 • 240 • 1

gaianet/gemma-2-2b-it-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 51

MaziyarPanahi/gemma-2-2b-it-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 92.2k • 14

mrmage/gemma-2-2b-it-Q4_K_M-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 14

joehirstdev/gemma-2-2b-it-Q4_K_M-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 19 • 1

mrmage/gemma-2-2b-it-Q3_K_M-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 40

qnixsynapse/Gemma-V2-2B-Instruct-GGUF

Text Generation • 3B • Updated Aug 13, 2024 • 13

cha9ro/gemma-2-2b-it-Q4_K_M-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 18

wiktorwojcik112/gemma-2-2b-it-Q4_K_M-GGUF

Text Generation • 3B • Updated Aug 1, 2024 • 39