Vincent-Lee commited on
Commit
aab60bc
·
verified ·
1 Parent(s): 815dbf7

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -0
README.md CHANGED
@@ -16,6 +16,9 @@ tags:
16
  # It's a gguf model file of gemma-3-12b-it, which is developed by Google.
17
 
18
  It's very applicable for deploying and using in PCs, laptops or mobiles.
 
 
 
19
 
20
  # If you are a Mac user, the following free wonderful AI tools can help you to read and understand PDFs effectively:
21
  - If you are using Zotero for managing and reading your personal PDFs, [PapersGPT](https://www.papersgpt.com) is a free plugin which can assist you to chat PDFs effectively by your local gemma-3-12b-it.
 
16
  # It's a gguf model file of gemma-3-12b-it, which is developed by Google.
17
 
18
  It's very applicable for deploying and using in PCs, laptops or mobiles.
19
+ gemma-3-12b-it-q4_0.gguf is the quantization-aware trained(QAT) checkpoints of Gemma 3, 3x less VRAM, while retaining almost the same quality. Recommend it.
20
+
21
+
22
 
23
  # If you are a Mac user, the following free wonderful AI tools can help you to read and understand PDFs effectively:
24
  - If you are using Zotero for managing and reading your personal PDFs, [PapersGPT](https://www.papersgpt.com) is a free plugin which can assist you to chat PDFs effectively by your local gemma-3-12b-it.