Hugging Face's logo

AIDC-AI
/
Ovis2.5-9B

Image-Text-to-Text
Transformers
Safetensors
English
Chinese
ovis2_5
text-generation
MLLM
conversational
custom_code
Model card Files Community
8

Quantization support

#5
by princemjp - opened
Discussion
princemjp

Would there be any awq or bitsandbytes quantization support for this model?

ThetaCursed

Most likely, in a month and a half they will add GPTQ-Int8 and int4

Sign up or log in to comment