HectorHe
/

Deepseek-Coder-V2-Lite-13B-Instruct-Math10K-Distill-6-experts-token-specific-3-scaled

Model card Files Files and versions

Deepseek-Coder-V2-Lite-13B-Instruct-Math10K-Distill-6-experts-token-specific-3-scaled

5.33 GB

1 contributor

History: 9 commits

HectorHe's picture

Training in progress, step 800

0908cd4 verified 3 months ago

.gitattributes

1.52 kB

initial commit 3 months ago
chat_template.jinja

459 Bytes

Training in progress, step 100 3 months ago
config.json

1.68 kB

Training in progress, step 100 3 months ago
expert_selection.log

14.9 kB

Training in progress, step 100 3 months ago
model-00001-of-00002.safetensors

4.9 GB
xet

Training in progress, step 800 3 months ago
model-00002-of-00002.safetensors

419 MB
xet

Training in progress, step 800 3 months ago
model.safetensors.index.json

72.1 kB

Training in progress, step 100 3 months ago
special_tokens_map.json

369 Bytes

Training in progress, step 100 3 months ago
tokenizer.json

7.5 MB

Training in progress, step 100 3 months ago
tokenizer_config.json

3.93 kB

Training in progress, step 100 3 months ago
top_6_experts_lmms-lab_Math10K.json

1.24 kB

Training in progress, step 100 3 months ago
training.log

10.5 kB

Training in progress, step 100 3 months ago
training_args.bin
Detected Pickle imports (14)
- "transformers.trainer_utils.IntervalStrategy",
- "transformers.trainer_utils.SaveStrategy",
- "accelerate.utils.dataclasses.DistributedType",
- "transformers.integrations.deepspeed.HfDeepSpeedConfig",
- "transformers.training_args.OptimizerNames",
- "transformers.trainer_utils.HubStrategy",
- "trainers.efficient_distillation_config.EfficientDistillationConfig",
- "accelerate.state.PartialState",
- "transformers.trainer_utils.SchedulerType",
- "torch.bfloat16",
- "transformers.trainer_pt_utils.AcceleratorConfig",
- "transformers.integrations.deepspeed.HfTrainerDeepSpeedConfig",
- "accelerate.utils.dataclasses.DeepSpeedPlugin",
- "torch.device"
How to fix it?
8.18 kB
xet

Training in progress, step 100 3 months ago