fix loading emissions (#1375)
fix loading emissions (#1375)

Summary:
broken in last change to infer.py

Pull Request resolved: https://github.com/fairinternal/fairseq-py/pull/1375

Reviewed By: xuqiantong

Differential Revision: D24531499

Pulled By: alexeib

fbshipit-source-id: fab60abf67a05c48e1ff750fac3ab6d4c0fa2770

pytorch/fairseq,pytorch/fairseq,pytorch/fairseq