Working 0.6B-Reranker Quants

#16
by JonathanMiddleton - opened

I was unable to find a working 0.6B-Reranker quant so I added a set here: https://huggingface.co/JonathanMiddleton/Qwen3-Reranker-0.6B. These have been verified with ngxson's unmerged llama.cpp branch. Details in the model card.

Thank you so much for these models!

Sign up or log in to comment