Multi-Domain-Expert-Learning

/

Aurora-test-iter_0000010

like 0

Follow

Aurora-M/MDEL 117

• "torch._utils._rebuild_tensor_v2",
• "collections.OrderedDict",
• "torch.FloatStorage",
• "torch.float32"

How to fix it?

• "megatron.core.enums.ModelType",
• "torch._utils._rebuild_tensor_v2",
• "numpy.core.multiarray._reconstruct",
• "argparse.Namespace",
• "torch.ByteStorage",
• "numpy.dtype",
• "_codecs.encode",
• "torch.bfloat16",
• "numpy.ndarray",
• "torch.BFloat16Storage",
• "collections.OrderedDict",
• "megatron.model.enums.PositionEmbeddingType"

How to fix it?