Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

lapp0
/
distily_bench_obj_cross_v2.12b_gpt2

TensorBoard
Safetensors
Distily
gpt2
Generated from Trainer
8-bit precision
bitsandbytes
Model card Files Files and versions Metrics Training metrics Community
distily_bench_obj_cross_v2.12b_gpt2 / logs
113 MB
  • 1 contributor
History: 10 commits

This model has 1 file scanned as unsafe.

lapp0's picture
lapp0
End of training
fd69b9f verified about 1 year ago
  • learning_rate=0.0001, per_device_train_batch_size=1, warmup_ratio=0.5
    End of training about 1 year ago
  • learning_rate=0.0001, per_device_train_batch_size=4, warmup_ratio=0.5
    End of training about 1 year ago
  • learning_rate=0.0001, per_device_train_batch_size=8, warmup_ratio=0.5
    End of training about 1 year ago
  • learning_rate=1e-05, per_device_train_batch_size=1, warmup_ratio=0.5
    End of training about 1 year ago
  • learning_rate=1e-05, per_device_train_batch_size=4, warmup_ratio=0.5
    Training in progress, step 59400 about 1 year ago
  • learning_rate=4e-05, per_device_train_batch_size=1, warmup_ratio=0.5
    End of training about 1 year ago
  • learning_rate=4e-05, per_device_train_batch_size=4, warmup_ratio=0.5
    Training in progress, step 59400 about 1 year ago
  • learning_rate=4e-05, per_device_train_batch_size=8, warmup_ratio=0.5
    End of training about 1 year ago