Multi-Domain-Expert-Learning

/

Aurora-42.5k-megatron

like 0

Follow

Aurora-M/MDEL 115

• "collections.OrderedDict",
• "torch.FloatStorage",
• "torch.float32",
• "torch._utils._rebuild_tensor_v2"

How to fix it?

• "torch.BFloat16Storage",
• "torch.ByteStorage",
• "megatron.core.enums.ModelType",
• "numpy.ndarray",
• "numpy.core.multiarray._reconstruct",
• "megatron.model.enums.PositionEmbeddingType",
• "collections.OrderedDict",
• "_codecs.encode",
• "argparse.Namespace",
• "torch.bfloat16",
• "torch._utils._rebuild_tensor_v2",
• "numpy.dtype"

How to fix it?