Can ovis2.5 running without flash attention?

#4
by Edmunddwu - opened

Please support old GPU like V100.

AIDC-AI org

Hi, we’ve added SDPA support in the code, so it can now run without flash-attention.

Hi, we’ve added SDPA support in the code, so it can now run without flash-attention.

emm...It seems like not support batch inference and has a low GPU utilization rate, but thanks for your work either.

Sign up or log in to comment