Is it possible to release the weight of ibot head and dino head of ViT-7B ?

#4
by strangerTHU - opened

Hi Meta AI team,

Thank you for open-sourcing the powerful DINOv3 vision backbones.

I am hoping to study the knowledge distillation process from the large ViT-7B to the smaller models. To do this, the weights for the iBOT and DINO heads used during pre-training are essential.

Would you consider releasing the weights for these heads? It would be incredibly helpful for researchers like myself who are focused on replicating and understanding your distillation methodology.

Thanks for all your great work!

Sign up or log in to comment