Fix nightly runs (#20352)
Fix nightly runs (#20352)

* Fix nightly runs

* Fix type

* Address review comment
huggingface/transformers,huggingface/transformers,huggingface/transformers,huggingface/transformers