NVFP4 Quantization

This repository provides NVFP4 quantization support for Kimi-K2-Instruct.

Downloads last month
27
Safetensors
Model size
581B params
Tensor type
F32
·
BF16
·
F8_E4M3
·
U8
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support