Creating quantization
#4
by cmp-nct - opened
Mind sharing how you created this quantization ? Maybe sharing the code for it ?
Maybe I'm just clumsy, the new mxfp4 code caused me issues replicating the model
Mind sharing how you created this quantization ? Maybe sharing the code for it ?
Maybe I'm just clumsy, the new mxfp4 code caused me issues replicating the model