Transformer encoder fp16 compatibility (#1714)
Transformer encoder fp16 compatibility (#1714)

* Transformer encoder mean reduction used a hard conversion .float() which is not compatible with float 16. change that

facebookresearch/ParlAI,facebookresearch/ParlAI,facebookresearch/ParlAI,facebookresearch/ParlAI,facebookresearch/ParlAI