Hugging Face's logo

trl-internal-testing
/
tiny-Qwen2_5_VLForConditionalGeneration

Image-to-Text
Transformers
Safetensors
qwen2_5_vl
trl
text-generation-inference
Model card Files
xet
Community
2

Upload Qwen2_5_VLForConditionalGeneration

#2
by albertvillanova HF Staff - opened
base: refs/heads/main
←
from: refs/pr/2
Discussion Files changed
+5
-39
albertvillanova
 trl internal testing org
•
edited 1 day ago

This PR required to override twice the rope_scalingconfig parameter:

config.text_config.rope_scaling["mrope_section"] = [2]
config.rope_scaling["mrope_section"] = [2]

See discussion in: https://github.com/huggingface/trl/pull/4101#issuecomment-3305880106

Upload Qwen2_5_VLForConditionalGeneration9f76fadb
albertvillanova changed pull request status to merged

Sign up or log in to comment