turboderp
/

Qwen2.5-7B-Instruct-exl3

Model card Files Files and versions

EXL3 quants of Qwen2.5-7B-Instruct

2.00 bits per weight
2.25 bits per weight
2.50 bits per weight
3.00 bits per weight
3.50 bits per weight
4.00 bits per weight
5.00 bits per weight
6.00 bits per weight
8.00 bits per weight
8.00 bits per weight / H8

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Collection including turboderp/Qwen2.5-7B-Instruct-exl3

EXL3 models

28 items • Updated 21 days ago • 34