lapp0
/

istily_bench_gpt2_simple_objectives

Generated from Trainer

8-bit precision

Model card Files Files and versions

Metrics Training metrics Community

istily_bench_gpt2_simple_objectives / logs

5.84 MB

1 contributor

History: 2 commits

lapp0's picture

End of training

b2c2f51 verified about 1 year ago

distillation_objective=MultiObjective(logits_weight_1__logits_loss_fn_(fn_kl_divergence_loss())__activations_weight_0__activations_loss_fn_(fn_mse_loss())__attentions_weight_0__attentions_loss_fn_(fn_
End of training about 1 year ago