add rope_type:yarn
#7
by
eliebak
HF Staff
- opened
I think this should be rope_type:"yarn" and not rope_type:"original" from what i see in the sglang modeling code + the use of beta_fast and beta_slow
LGTM!
I think this should be rope_type:"yarn" and not rope_type:"original" from what i see in the sglang modeling code + the use of beta_fast and beta_slow
LGTM!