Hugging Face's logo

lapp0
/
distily_bench_gpt2_activation_loss

TensorBoard
Safetensors
Distily
gpt2
Generated from Trainer
8-bit precision
bitsandbytes
Model card Files Metrics Community
lapp0 commited on
Commit
eddd1df
·
verified ·
1 Parent(s): 1bdb261

Training in progress, step 24750

Browse files
Files changed (4) hide show
  1. logs/distillation_objective=MultiObjective(logits_weight_1__logits_loss_fn_(fn_kl_divergence_loss())__hs_weight_0.2__hs_loss_fn_(fn_mse_loss())__attn_weight_0__attn_loss_fn_(fn_soft_mse_loss()))/events.out.tfevents.1723599531.93d6cbb3ad53 +3 -0
  2. logs/distillation_objective=MultiObjective(logits_weight_1__logits_loss_fn_(fn_kl_divergence_loss())__hs_weight_0.2__hs_loss_fn_(fn_soft_mse_loss())__attn_weight_0__attn_loss_fn_(fn_soft_mse_loss()))/events.out.tfevents.1723599359.93d6cbb3ad53 +2 -2
  3. model.safetensors +1 -1
  4. training_args.bin +1 -1
logs/distillation_objective=MultiObjective(logits_weight_1__logits_loss_fn_(fn_kl_divergence_loss())__hs_weight_0.2__hs_loss_fn_(fn_mse_loss())__attn_weight_0__attn_loss_fn_(fn_soft_mse_loss()))/events.out.tfevents.1723599531.93d6cbb3ad53 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:104a2b284e5c7b27eeb4435563702b465c7285094c1f34990bdbf36efc5b2cef
3
+ size 6729486
logs/distillation_objective=MultiObjective(logits_weight_1__logits_loss_fn_(fn_kl_divergence_loss())__hs_weight_0.2__hs_loss_fn_(fn_soft_mse_loss())__attn_weight_0__attn_loss_fn_(fn_soft_mse_loss()))/events.out.tfevents.1723599359.93d6cbb3ad53 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2858383b0d812475adeac8a73ce70f310e0d959c6553ab5dc83bc1150cb80e68
3
- size 253
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4ce902551e260d94b8df8c4d534e093d9728f3cabb8e82bc17d368fddf70e56d
3
+ size 529
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:ba45d5826a27c0efdc37714803a9eb57281379c081ff16edf39e29fdac61e456
3
  size 248894656
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b5bbd08c3dcb50ec1344b3913c2239ceaded499254761b3fa26a05a9d300a7f9
3
  size 248894656
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:86e592231dc6f32e4e8d20422e9bc975a5bd1d844a9354cd5b7a99475197191c
3
  size 907106756
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:983e44c17957d4070aa06a302831b03d36ff9d67798a975468fc6de12346aaa9
3
  size 907106756