Experimental versions of FP-Quant models
-
daslab-testing/Llama-3.1-8B-Instruct-mxfp-w4-a4-MicroQAT-hadamard-transform
5B • Updated • 2 -
daslab-testing/Llama-3.1-8B-Instruct-nvfp-w4-a4-MicroQAT-hadamard-transform
5B • Updated • 3 -
daslab-testing/Llama-3.2-3B-Instruct-nvfp-w4-a4-MicroQAT-hadamard-transform
2B • Updated • 1 -
daslab-testing/Llama-3.2-3B-Instruct-mxfp-w4-a4-MicroQAT-hadamard-transform
2B • Updated • 2