Hugging Face's logo

AIDC-AI
/
Ovis2.5-2B

Image-Text-to-Text
Transformers
Safetensors
English
Chinese
ovis2_5
text-generation
MLLM
conversational
custom_code
Model card Files Community
5

Add SDPA fallback for Siglip2Navit attention

#5
by Isotr0py - opened
base: refs/heads/main
←
from: refs/pr/5
Discussion Files changed
+61
-6
Isotr0py
•
edited 2 days ago

Add SDPA fallback for ViT Attention to allow running inference on machine without flash-attn

add sdpa fallback8d086dc4
Isotr0py changed pull request title from sdpa-fallback to Add SDPA fallback for Siglip2Navit attention
Isotr0py changed pull request status to open
cleanad6d85fb
Edmunddwu
•
edited 1 day ago

It seems like not support batch but single inference? Thanks for your work!

xxyyy123 changed pull request status to merged
xxyyy123
 AIDC-AI org

@Isotr0py Thank you for adding SDPA support🚀, which facilitates running inference in environments without flash-attn.

Sign up or log in to comment