Quantized from Qwen/Qwen2.5-7B-Instruct-1M down to 4 bits, GEMM
- Downloads last month
- 170
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support
Quantized from Qwen/Qwen2.5-7B-Instruct-1M down to 4 bits, GEMM