[PyTorch-nightly-test] Fix Wav2Vec2 LM & Phoneme tests (#15272)
[PyTorch-nightly-test] Fix Wav2Vec2 LM & Phoneme tests (#15272)

* [PyTorch-nightly-test] Fix Wav2Vec2 LM & Phoneme tests

* Update .github/workflows/self-nightly-scheduled.yml

* change lines

* Apply suggestions from code review
huggingface/transformers,huggingface/transformers,huggingface/transformers,huggingface/transformers