Allow varying number of student model heads during distillation (#3447)
Allow varying number of student model heads during distillation (#3447)

* Allow number of attention heads to vary

* Put checks behind shared
facebookresearch/ParlAI,facebookresearch/ParlAI,facebookresearch/ParlAI,facebookresearch/ParlAI,facebookresearch/ParlAI