Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up
gaunernst 's Collections
DeepSeek testing
Gemma 3 QAT INT4 (from GGUF)
Gemma 3 QAT INT4 (from Flax)
Mini BERT models
Face Recognition Models
LLMs < 1B
LLMs 1B - 2B
LLMs 2B - 4B
Smallish LLM pre-training datasets
Llama2-compatible
Llama3-compatible

Gemma 3 QAT INT4 (from Flax)

updated Apr 6

These are converted from the official QAT INT4 Flax checkpoints on Kaggle. Supported formats: AutoAWQ, GGUF

Upvote
5

  • gaunernst/gemma-3-1b-it-int4-awq

    Text Generation • Updated Apr 6 • 3.64k • 2

  • gaunernst/gemma-3-4b-it-int4-awq

    Image-Text-to-Text • Updated Apr 6 • 1.52k • 1

  • gaunernst/gemma-3-12b-it-int4-awq

    Image-Text-to-Text • 3B • Updated Apr 6 • 2.89k • 16

  • gaunernst/gemma-3-27b-it-int4-awq

    Image-Text-to-Text • 6B • Updated Apr 6 • 25.6k • 29

  • gaunernst/gemma-3-1b-it-int4-gguf

    Text Generation • 1.0B • Updated Apr 6 • 56 • 3

  • gaunernst/gemma-3-4b-it-int4-gguf

    Image-Text-to-Text • 4B • Updated Apr 6 • 21

  • gaunernst/gemma-3-12b-it-int4-gguf

    Image-Text-to-Text • 12B • Updated Apr 6 • 8 • 1

  • gaunernst/gemma-3-27b-it-int4-gguf

    Image-Text-to-Text • 27B • Updated Apr 6 • 18 • 3

  • gaunernst/gemma-3-1b-it-int4

    Text Generation • Updated Mar 30 • 5

  • gaunernst/gemma-3-4b-it-int4

    Image-Text-to-Text • Updated Mar 29 • 28

  • gaunernst/gemma-3-12b-it-int4

    Image-Text-to-Text • 7B • Updated Mar 30 • 18

  • gaunernst/gemma-3-27b-it-int4

    15B • Updated Mar 31
Upvote
5
  • Collection guide
  • Browse collections
Company
TOS Privacy About Jobs
Website
Models Datasets OCR模型免费转Markdown Pricing 模型下载攻略