Hugging Face
Models
Datasets
Spaces
Community
Docs
Enterprise
Pricing
Log In
Sign Up
Mungert
/
SmallThinker-4BA0.6B-Instruct
like
0
Text Generation
GGUF
English
conversational
License:
apache-2.0
Model card
Files
Files and versions
xet
Community
Deploy
Use this model
main
SmallThinker-4BA0.6B-Instruct
Ctrl+K
Ctrl+K
1 contributor
History:
70 commits
Mungert
Delete file(s) containing ['q2_k_l.gguf', 'q3_k_l.gguf', 'q4_k_l.gguf', 'q5_k_l.gguf', 'q6_k_l.gguf', 'q4_0_l.gguf', 'q5_0_l.gguf', 'q4_1_l.gguf', 'q5_1_l.gguf', 'bf16_q6_k.gguf']
c39b984
verified
15 days ago
.gitattributes
Safe
4.09 kB
Upload SmallThinker-4BA0.6B-Instruct-q4_k_m.gguf with huggingface_hub
27 days ago
README.md
Safe
5.7 kB
Upload README.md with huggingface_hub
27 days ago
SmallThinker-4BA0.6B-Instruct-bf16.gguf
Safe
8.55 GB
xet
Upload SmallThinker-4BA0.6B-Instruct-bf16.gguf with huggingface_hub
27 days ago
SmallThinker-4BA0.6B-Instruct-bf16_q8_0.gguf
Safe
6.04 GB
xet
Upload SmallThinker-4BA0.6B-Instruct-bf16_q8_0.gguf with huggingface_hub
27 days ago
SmallThinker-4BA0.6B-Instruct-f16_q8_0.gguf
Safe
6.04 GB
xet
Upload SmallThinker-4BA0.6B-Instruct-f16_q8_0.gguf with huggingface_hub
27 days ago
SmallThinker-4BA0.6B-Instruct-imatrix.gguf
Safe
16.8 MB
xet
Upload SmallThinker-4BA0.6B-Instruct-imatrix.gguf with huggingface_hub
27 days ago
SmallThinker-4BA0.6B-Instruct-iq2_s.gguf
Safe
1.69 GB
xet
Upload SmallThinker-4BA0.6B-Instruct-iq2_s.gguf with huggingface_hub
27 days ago
SmallThinker-4BA0.6B-Instruct-iq2_xs.gguf
Safe
1.69 GB
xet
Upload SmallThinker-4BA0.6B-Instruct-iq2_xs.gguf with huggingface_hub
27 days ago
SmallThinker-4BA0.6B-Instruct-iq2_xxs.gguf
Safe
1.53 GB
xet
Upload SmallThinker-4BA0.6B-Instruct-iq2_xxs.gguf with huggingface_hub
27 days ago
SmallThinker-4BA0.6B-Instruct-q2_k_s.gguf
Safe
1.81 GB
xet
Upload SmallThinker-4BA0.6B-Instruct-q2_k_s.gguf with huggingface_hub
27 days ago
SmallThinker-4BA0.6B-Instruct-q3_k_m.gguf
Safe
2.37 GB
xet
Upload SmallThinker-4BA0.6B-Instruct-q3_k_m.gguf with huggingface_hub
27 days ago
SmallThinker-4BA0.6B-Instruct-q3_k_s.gguf
Safe
2.3 GB
xet
Upload SmallThinker-4BA0.6B-Instruct-q3_k_s.gguf with huggingface_hub
27 days ago
SmallThinker-4BA0.6B-Instruct-q4_0.gguf
Safe
2.41 GB
xet
Upload SmallThinker-4BA0.6B-Instruct-q4_0.gguf with huggingface_hub
27 days ago
SmallThinker-4BA0.6B-Instruct-q4_1.gguf
Safe
2.68 GB
xet
Upload SmallThinker-4BA0.6B-Instruct-q4_1.gguf with huggingface_hub
27 days ago
SmallThinker-4BA0.6B-Instruct-q4_k_m.gguf
Safe
2.77 GB
xet
Upload SmallThinker-4BA0.6B-Instruct-q4_k_m.gguf with huggingface_hub
27 days ago
SmallThinker-4BA0.6B-Instruct-q4_k_s.gguf
Safe
2.65 GB
xet
Upload SmallThinker-4BA0.6B-Instruct-q4_k_s.gguf with huggingface_hub
27 days ago
SmallThinker-4BA0.6B-Instruct-q5_0.gguf
Safe
2.95 GB
xet
Upload SmallThinker-4BA0.6B-Instruct-q5_0.gguf with huggingface_hub
27 days ago
SmallThinker-4BA0.6B-Instruct-q5_1.gguf
Safe
3.21 GB
xet
Upload SmallThinker-4BA0.6B-Instruct-q5_1.gguf with huggingface_hub
27 days ago
SmallThinker-4BA0.6B-Instruct-q5_k_m.gguf
Safe
3.17 GB
xet
Upload SmallThinker-4BA0.6B-Instruct-q5_k_m.gguf with huggingface_hub
27 days ago
SmallThinker-4BA0.6B-Instruct-q5_k_s.gguf
Safe
3.13 GB
xet
Upload SmallThinker-4BA0.6B-Instruct-q5_k_s.gguf with huggingface_hub
27 days ago
SmallThinker-4BA0.6B-Instruct-q6_k_m.gguf
Safe
3.51 GB
xet
Upload SmallThinker-4BA0.6B-Instruct-q6_k_m.gguf with huggingface_hub
27 days ago
SmallThinker-4BA0.6B-Instruct-q8_0.gguf
Safe
4.55 GB
xet
Upload SmallThinker-4BA0.6B-Instruct-q8_0.gguf with huggingface_hub
27 days ago