File size: 740 Bytes
e363006 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 |
Obtained with
```python
from transformers import WhisperForConditionalGeneration, WhisperConfig, WhisperProcessor, GenerationConfig
model_id = "openai/whisper-tiny"
orig_config = WhisperConfig.from_pretrained(model_id)
small_config = dict(
d_model=48,
encoder_layers=2,
decoder_layers=2,
encoder_attention_heads=3,
decoder_attention_heads=3,
encoder_ffn_dim=768,
decoder_ffn_dim=768,
)
small_config = WhisperConfig(**{**orig_config.to_dict(), **small_config})
save_dir = "tiny-random-whisper"
WhisperForConditionalGeneration(small_config).save_pretrained(save_dir)
WhisperProcessor.from_pretrained(model_id).save_pretrained(save_dir)
GenerationConfig.from_pretrained(model_id).save_pretrained(save_dir)
``` |