Models

ai21labs/AI21-Jamba-Large-1.7-FP8

399B • Updated Jul 6 • 76 • 2

inflatebot/Kimi-VL-A3B-Thinking-2506-FP8-Dynamic

16B • Updated Jul 13 • 672 • 1

t-tech/T-pro-it-2.0-AWQ

6B • Updated Jul 18 • 1.72k • 8

Ithanil/Llama-3_3-Nemotron-Super-49B-v1_5-FP8-Dynamic

50B • Updated 25 days ago • 60 • 1

cpatonn/Qwen3-30B-A3B-Thinking-2507-AWQ-4bit

Text Generation • 5B • Updated 25 days ago • 8.75k • 7

cpatonn/Qwen3-Coder-30B-A3B-Instruct-GPTQ-4bit

Text Generation • 5B • Updated 23 days ago • 2.82k • 4

cpatonn/MindLink-72B-0801-AWQ-4bit

Text Generation • 12B • Updated 22 days ago • 48 • 1

cpatonn/Qwen3-4B-Instruct-2507-AWQ-4bit

Text Generation • 1B • Updated 18 days ago • 2.42k • 1

cpatonn/Qwen3-Coder-30B-A3B-Instruct-AWQ-8bit

Text Generation • 9B • Updated 17 days ago • 83 • 1

SicariusSicariiStuff/Impish_Nemo_12B_FP8

Text Generation • 12B • Updated 15 days ago • 29 • 1

cpatonn/GLM-4.5V-AWQ-8bit

Image-Text-to-Text • 32B • Updated 11 days ago • 324 • 2

RedHatAI/gpt-oss-120b-FP8-Dynamic

Text Generation • 117B • Updated 10 days ago • 505 • 2

nm-testing/tinyllama-one-shot-static-quant-test-compressed

Text Generation • 1B • Updated Oct 9, 2024 • 6

nm-testing/tinyllama-one-shot-dynamic-test

Text Generation • 1B • Updated Oct 9, 2024 • 4

nm-testing/tinyllama-one-shot-w4a16-group-packed

Text Generation • 0.3B • Updated Oct 10, 2024 • 3

nm-testing/tinyllama-one-shot-w4a16-channel-compressed

Text Generation • 1B • Updated Oct 9, 2024 • 3

nm-testing/tinyllama-one-shot-w4a16-channel-packed

Text Generation • 0.3B • Updated Oct 9, 2024 • 4

nm-testing/llama7b-one-shot-2_4-w4a16-packed

Text Generation • 1B • Updated Oct 9, 2024 • 4

nm-testing/tinyllama-one-shot-w4a16-group128-packed

Text Generation • 0.3B • Updated Oct 9, 2024 • 3

nm-testing/llama3-8b-w8_channel-a8_tensor-compressed

Text Generation • 8B • Updated Oct 9, 2024 • 3

nm-testing/llama7b-one-shot-2_4-w4a16-marlin24

Text Generation • 0.9B • Updated Jun 4, 2024 • 3

nm-testing/llama7b-one-shot-2_4-w4a16-group128-packed

Text Generation • 1B • Updated Jun 4, 2024 • 3

nm-testing/llama1.1b_0.5_sparse_bitmask

Text Generation • 0.8B • Updated Oct 9, 2024 • 3

nm-testing/llama7b-one-shot-2_4-w4a16-marlin24-t

Text Generation • 1B • Updated Oct 9, 2024 • 11.3k • 1

nm-testing/tinyllama-one-shot-w8a8-dynamic-channel

Text Generation • 1B • Updated Oct 9, 2024 • 4

nm-testing/llama7b-one-shot-2_4-w4a16-marlin24-t-alt

Text Generation • 0.9B • Updated Oct 9, 2024 • 4

nm-testing/tinyllama-marlin24-w4a16-group128

Text Generation • 0.3B • Updated Oct 9, 2024 • 3

nm-testing/tinyllama-oneshot-w8a8-static-v2

Text Generation • 1B • Updated Oct 9, 2024 • 5

nm-testing/tinyllama-oneshot-w8a8-dynamic-token-v2

Text Generation • 1B • Updated Oct 9, 2024 • 12.7k

nm-testing/tinyllama-oneshot-w8a8-static-v3

Text Generation • 1B • Updated Jun 17, 2024 • 5