Mungert
/

SmallThinker-4BA0.6B-Instruct

Text Generation

Model card Files Files and versions

SmallThinker-4BA0.6B-Instruct

110 GB

1 contributor

History: 52 commits

Mungert's picture

Upload SmallThinker-4BA0.6B-Instruct-q2_k_s.gguf with huggingface_hub

00bb4a9 verified about 2 months ago

.gitattributes

3.94 kB

Upload SmallThinker-4BA0.6B-Instruct-q2_k_s.gguf with huggingface_hub about 2 months ago
README.md

5.7 kB

Upload README.md with huggingface_hub about 2 months ago
SmallThinker-4BA0.6B-Instruct-bf16.gguf

8.55 GB
xet

Upload SmallThinker-4BA0.6B-Instruct-bf16.gguf with huggingface_hub about 2 months ago
SmallThinker-4BA0.6B-Instruct-bf16_q4_k.gguf

4.87 GB
xet

Upload SmallThinker-4BA0.6B-Instruct-bf16_q4_k.gguf with huggingface_hub about 2 months ago
SmallThinker-4BA0.6B-Instruct-bf16_q6_k.gguf

5.4 GB
xet

Upload SmallThinker-4BA0.6B-Instruct-bf16_q6_k.gguf with huggingface_hub about 2 months ago
SmallThinker-4BA0.6B-Instruct-bf16_q8_0.gguf

6.04 GB
xet

Upload SmallThinker-4BA0.6B-Instruct-bf16_q8_0.gguf with huggingface_hub about 2 months ago
SmallThinker-4BA0.6B-Instruct-f16.gguf

8.55 GB
xet

Upload SmallThinker-4BA0.6B-Instruct-f16.gguf with huggingface_hub about 2 months ago
SmallThinker-4BA0.6B-Instruct-f16_q4_k.gguf

4.87 GB
xet

Upload SmallThinker-4BA0.6B-Instruct-f16_q4_k.gguf with huggingface_hub about 2 months ago
SmallThinker-4BA0.6B-Instruct-f16_q6_k.gguf

5.4 GB
xet

Upload SmallThinker-4BA0.6B-Instruct-f16_q6_k.gguf with huggingface_hub about 2 months ago
SmallThinker-4BA0.6B-Instruct-f16_q8_0.gguf

6.04 GB
xet

Upload SmallThinker-4BA0.6B-Instruct-f16_q8_0.gguf with huggingface_hub about 2 months ago
SmallThinker-4BA0.6B-Instruct-imatrix.gguf

16.8 MB
xet

Upload SmallThinker-4BA0.6B-Instruct-imatrix.gguf with huggingface_hub about 2 months ago
SmallThinker-4BA0.6B-Instruct-iq2_s.gguf

1.69 GB
xet

Upload SmallThinker-4BA0.6B-Instruct-iq2_s.gguf with huggingface_hub about 2 months ago
SmallThinker-4BA0.6B-Instruct-iq2_xs.gguf

1.69 GB
xet

Upload SmallThinker-4BA0.6B-Instruct-iq2_xs.gguf with huggingface_hub about 2 months ago
SmallThinker-4BA0.6B-Instruct-iq2_xxs.gguf

1.53 GB
xet

Upload SmallThinker-4BA0.6B-Instruct-iq2_xxs.gguf with huggingface_hub about 2 months ago
SmallThinker-4BA0.6B-Instruct-q2_k_s.gguf

1.81 GB
xet

Upload SmallThinker-4BA0.6B-Instruct-q2_k_s.gguf with huggingface_hub about 2 months ago
SmallThinker-4BA0.6B-Instruct-q3_k_l.gguf

2.48 GB
xet

Upload SmallThinker-4BA0.6B-Instruct-q3_k_l.gguf with huggingface_hub about 2 months ago
SmallThinker-4BA0.6B-Instruct-q3_k_m.gguf

2.37 GB
xet

Upload SmallThinker-4BA0.6B-Instruct-q3_k_m.gguf with huggingface_hub about 2 months ago
SmallThinker-4BA0.6B-Instruct-q3_k_s.gguf

2.3 GB
xet

Upload SmallThinker-4BA0.6B-Instruct-q3_k_s.gguf with huggingface_hub about 2 months ago
SmallThinker-4BA0.6B-Instruct-q4_0.gguf

2.41 GB
xet

Upload SmallThinker-4BA0.6B-Instruct-q4_0.gguf with huggingface_hub about 2 months ago
SmallThinker-4BA0.6B-Instruct-q4_0_l.gguf

2.65 GB
xet

Upload SmallThinker-4BA0.6B-Instruct-q4_0_l.gguf with huggingface_hub about 2 months ago
SmallThinker-4BA0.6B-Instruct-q4_1.gguf

2.68 GB
xet

Upload SmallThinker-4BA0.6B-Instruct-q4_1.gguf with huggingface_hub about 2 months ago
SmallThinker-4BA0.6B-Instruct-q4_1_l.gguf

2.88 GB
xet

Upload SmallThinker-4BA0.6B-Instruct-q4_1_l.gguf with huggingface_hub about 2 months ago
SmallThinker-4BA0.6B-Instruct-q4_k_l.gguf

2.88 GB
xet

Upload SmallThinker-4BA0.6B-Instruct-q4_k_l.gguf with huggingface_hub about 2 months ago
SmallThinker-4BA0.6B-Instruct-q4_k_s.gguf

2.65 GB
xet

Upload SmallThinker-4BA0.6B-Instruct-q4_k_s.gguf with huggingface_hub about 2 months ago
SmallThinker-4BA0.6B-Instruct-q5_0.gguf

2.95 GB
xet

Upload SmallThinker-4BA0.6B-Instruct-q5_0.gguf with huggingface_hub about 2 months ago
SmallThinker-4BA0.6B-Instruct-q5_0_l.gguf

3.12 GB
xet

Upload SmallThinker-4BA0.6B-Instruct-q5_0_l.gguf with huggingface_hub about 2 months ago
SmallThinker-4BA0.6B-Instruct-q5_1.gguf

3.21 GB
xet

Upload SmallThinker-4BA0.6B-Instruct-q5_1.gguf with huggingface_hub about 2 months ago
SmallThinker-4BA0.6B-Instruct-q5_1_l.gguf

3.36 GB
xet

Upload SmallThinker-4BA0.6B-Instruct-q5_1_l.gguf with huggingface_hub about 2 months ago
SmallThinker-4BA0.6B-Instruct-q5_k_l.gguf

3.28 GB
xet

Upload SmallThinker-4BA0.6B-Instruct-q5_k_l.gguf with huggingface_hub about 2 months ago
SmallThinker-4BA0.6B-Instruct-q5_k_m.gguf

3.17 GB
xet

Upload SmallThinker-4BA0.6B-Instruct-q5_k_m.gguf with huggingface_hub about 2 months ago
SmallThinker-4BA0.6B-Instruct-q5_k_s.gguf

3.13 GB
xet

Upload SmallThinker-4BA0.6B-Instruct-q5_k_s.gguf with huggingface_hub about 2 months ago
SmallThinker-4BA0.6B-Instruct-q6_k_m.gguf

3.51 GB
xet

Upload SmallThinker-4BA0.6B-Instruct-q6_k_m.gguf with huggingface_hub about 2 months ago
SmallThinker-4BA0.6B-Instruct-q8_0.gguf

4.55 GB
xet

Upload SmallThinker-4BA0.6B-Instruct-q8_0.gguf with huggingface_hub about 2 months ago