lapp0
/

distily_bench_obj_cross_v2.12b_gpt2

Generated from Trainer

8-bit precision

Model card Files Files and versions

Metrics Training metrics Community

distily_bench_obj_cross_v2.12b_gpt2 / logs

42.5 MB

1 contributor

History: 3 commits

This model has 1 file scanned as unsafe.

lapp0's picture

End of training

ad1087f verified over 1 year ago

learning_rate=0.0001, per_device_train_batch_size=1, warmup_ratio=0.5
End of training over 1 year ago
learning_rate=0.0001, per_device_train_batch_size=4, warmup_ratio=0.5
End of training over 1 year ago
learning_rate=4e-05, per_device_train_batch_size=4, warmup_ratio=0.5
End of training over 1 year ago