lapp0
/

istily_bench_gpt2_simple_objectives

Generated from Trainer

8-bit precision

Model card Files Files and versions

Metrics Training metrics Community

istily_bench_gpt2_simple_objectives / logs

5.84 MB

1 contributor

History: 1 commit

This model has 1 file scanned as unsafe.

lapp0's picture

Training in progress, step 24750

32d2b5d verified over 1 year ago

distillation_objective=MultiObjective(logits_weight_1__logits_loss_fn_(fn_kl_divergence_loss())__activations_weight_0__activations_loss_fn_(fn_mse_loss())__attentions_weight_0__attentions_loss_fn_(fn_
Training in progress, step 24750 over 1 year ago