Could we try quantizing it to fp8?
#1
by win10 - opened
@danielhanchen Could we try quantizing it to fp8?
https://huggingface.co/huihui-ai/Huihui-Qwen3-Coder-Next-abliterated
@danielhanchen Could we try quantizing it to fp8?
https://huggingface.co/huihui-ai/Huihui-Qwen3-Coder-Next-abliterated