MXFP4 support

#6
by Maria99934 - opened

Hello, should we expect MXFP4 in the near future?
Are you planning to release this version of the model?

Jinx org

I have built an MXFP4, but it is not functioning properly. I'll try it again this weekend.

I have built an MXFP4, but it is not functioning properly. I'll try it again this weekend.

Thank you for your precious work and the time you devote to this. 🙏🙏🙏

I have built an MXFP4, but it is not functioning properly. I'll try it again this weekend.

Greetings, MXFP4 versions are already available.
They are magnificent!

https://huggingface.co/marcelone/jinx-gpt-oss-20b-gguf

Sign up or log in to comment