Can ovis2.5 running without flash attention?
#4
by
Edmunddwu
- opened
Please support old GPU like V100.
Hi, we’ve added SDPA support in the code, so it can now run without flash-attention.
Hi, we’ve added SDPA support in the code, so it can now run without flash-attention.
emm...It seems like not support batch inference and has a low GPU utilization rate, but thanks for your work either.