ChenMnZ/Llama-3-8b-instruct-EfficientQAT-w4g128
Text Generation • 2B • Updated • 6
EfficientQAT
The official prequantized EfficientQAT models.
-
-
ChenMnZ/Llama-3-8b-instruct-EfficientQAT-w2g64
Text Generation • 2B • Updated • 11 -
ChenMnZ/Llama-3-8b-instruct-EfficientQAT-w2g128
Text Generation • 2B • Updated • 11 -
ChenMnZ/Llama-3-8b-EfficientQAT-w4g128
Text Generation • 2B • Updated • 9 -
ChenMnZ/Llama-3-8b-EfficientQAT-w3g128
Text Generation • 2B • Updated • 76 -
ChenMnZ/Llama-3-8b-EfficientQAT-w2g64
Text Generation • 2B • Updated • 7 -
ChenMnZ/Llama-3-8b-EfficientQAT-w2g128
Text Generation • 2B • Updated • 5 -
ChenMnZ/Llama-3-70b-instruct-EfficientQAT-w4g128
Text Generation • 11B • Updated • 7 -
ChenMnZ/Llama-3-70b-instruct-EfficientQAT-w3g128
Text Generation • 10B • Updated • 8 -
ChenMnZ/Llama-3-70b-instruct-EfficientQAT-w2g64
Text Generation • 8B • Updated • 5 -
ChenMnZ/Llama-3-70b-instruct-EfficientQAT-w2g128
Text Generation • 7B • Updated • 5 -
ChenMnZ/Llama-2-7b-EfficientQAT-w4g128
Text Generation • 1B • Updated • 7 -
ChenMnZ/Llama-2-7b-EfficientQAT-w3g128
Text Generation • 1.0B • Updated • 6 -
ChenMnZ/Llama-2-7b-EfficientQAT-w2g64
Text Generation • 0.8B • Updated • 9 -
ChenMnZ/Llama-2-7b-EfficientQAT-w2g128
Text Generation • 0.7B • Updated • 7 -
ChenMnZ/Llama-2-70b-EfficientQAT-w2g64
Text Generation • 6B • Updated • 4 -
ChenMnZ/Llama-2-70b-EfficientQAT-w2g128
Text Generation • 5B • Updated • 6 -
ChenMnZ/Llama-2-13b-EfficientQAT-w4g128
Text Generation • 2B • Updated • 5 -
ChenMnZ/Llama-2-13b-EfficientQAT-w3g128
Text Generation • 2B • Updated • 10 -
ChenMnZ/Llama-2-13b-EfficientQAT-w2g64
Text Generation • 1B • Updated • 5 -
ChenMnZ/Llama-2-13b-EfficientQAT-w2g128
Text Generation • 1B • Updated • 7 -
ChenMnZ/Llama-3-8b-instruct-EfficientQAT-w3g128
Text Generation • 2B • Updated • 8 -
ChenMnZ/Llama-3-70b-EfficientQAT-w4g128
Text Generation • 11B • Updated • 6 • 1 -
ChenMnZ/Llama-3-70b-EfficientQAT-w3g128
Text Generation • 10B • Updated • 5 • 1 -
ChenMnZ/Llama-3-70b-EfficientQAT-w2g64
Text Generation • 8B • Updated • 8 • 1 -
ChenMnZ/Llama-2-70b-EfficientQAT-w4g128
Text Generation • 10B • Updated • 11 • 1 -
ChenMnZ/Llama-2-70b-EfficientQAT-w3g128
Text Generation • 8B • Updated • 8 • 1 -
ChenMnZ/Llama-3-70b-EfficientQAT-w2g128
Text Generation • 7B • Updated • 7 • 1 -
EfficientQAT: Efficient Quantization-Aware Training for Large Language Models
Paper • 2407.11062 • Published • 10