Correct restoring of ViT pretrained checkpoints, when the restored model has a CLS token and the target model does not.
Correct restoring of ViT pretrained checkpoints, when the restored model has a CLS token and the target model does not.

PiperOrigin-RevId: 427412722

google-research/scenic