Hugging Face's logo

lapp0
/
distily_bench_gpt2_simple_objectives2

TensorBoard
Safetensors
Distily
gpt2
Generated from Trainer
8-bit precision
bitsandbytes
Model card Files
xet
Metrics Community
lapp0 commited on
Commit
7b70bef
·
verified ·
1 Parent(s): db37acb

Training in progress, step 24750

Browse files
Files changed (4) hide show
  1. logs/distillation_objective=MultiObjective(logits_weight_1__logits_loss_fn_(fn_kl_divergence_loss())__activations_weight_0.2__activations_loss_fn_(fn_soft_mse_loss())__attentions_weight_0__attentions_loss_/events.out.tfevents.1723493239.93d6cbb3ad53 +2 -2
  2. logs/distillation_objective=MultiObjective(logits_weight_1__logits_loss_fn_(fn_kl_divergence_loss())__activations_weight_0.5__activations_loss_fn_(fn_soft_mse_loss())__attentions_weight_0__attentions_loss_/events.out.tfevents.1723493414.93d6cbb3ad53 +3 -0
  3. model.safetensors +1 -1
  4. training_args.bin +1 -1
logs/distillation_objective=MultiObjective(logits_weight_1__logits_loss_fn_(fn_kl_divergence_loss())__activations_weight_0.2__activations_loss_fn_(fn_soft_mse_loss())__attentions_weight_0__attentions_loss_/events.out.tfevents.1723493239.93d6cbb3ad53 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c9c7af8b06c03c72dd60e14f12efe2a0e423a5f5907632fc0c8bd088dbe40497
3
- size 253
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8d34a73dff489530993933d9182ffa2032ea5388426a2727e10d105b2834396e
3
+ size 529
logs/distillation_objective=MultiObjective(logits_weight_1__logits_loss_fn_(fn_kl_divergence_loss())__activations_weight_0.5__activations_loss_fn_(fn_soft_mse_loss())__attentions_weight_0__attentions_loss_/events.out.tfevents.1723493414.93d6cbb3ad53 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2c20497c2f263e772d3a795dc3b064821915dec8cb5026c85b1bf34214f558f5
3
+ size 5607523
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2882f3b13c4b4e5df29495ec326744ca332728ed2cdf637f59bd60279ed369d3
3
  size 248894656
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4e5678787142ba8882ea2b2ed27892df9f479df09e148fe2a6dd94f1c50a1e48
3
  size 248894656
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:843bd164da15c0c886e1e0dcbfbc3af82bbf36555bbbe35a28749a2e2e7c7845
3
  size 907106756
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:80e3be99c98e63cd4c965602f196cae381bd6cfa8623e7ac5723c0d848b32314
3
  size 907106756