bertin-project/bertin-base-stepwise-exp-512seqlen at b27028732a1fb6c872b5e1b4c47a9eb6ca7c8cfd

5.29 GB

3 contributors

Step... (19000/50000 | Loss: 1.6823453903198242, Acc: 0.6625654101371765): 39%|██████████▍ | 19301/50000 [7:34:52<11:40:44, 1.37s/it]

b270287 about 4 years ago

configs
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1286/50000 [29:40<20:20:20, 1.50s/it] about 4 years ago
outputs
Step... (19000/50000 | Loss: 1.6823453903198242, Acc: 0.6625654101371765): 39%|██████████▍ | 19301/50000 [7:34:52<11:40:44, 1.37s/it] about 4 years ago
wandb
Step... (19000/50000 | Loss: 1.6823453903198242, Acc: 0.6625654101371765): 39%|██████████▍ | 19301/50000 [7:34:52<11:40:44, 1.37s/it] about 4 years ago
.gitattributes

882 Bytes

Step... (14000/50000 | Loss: 1.7139594554901123, Acc: 0.6574689745903015): 29%|███████▋ | 14350/50000 [5:33:22<15:08:11, 1.53s/it] about 4 years ago
README.md

1.48 kB

Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1286/50000 [29:40<20:20:20, 1.50s/it] about 4 years ago
config.json

618 Bytes

Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1286/50000 [29:40<20:20:20, 1.50s/it] about 4 years ago
convert.py

876 Bytes

Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1286/50000 [29:40<20:20:20, 1.50s/it] about 4 years ago
flax_model.msgpack

250 MB
xet

Step... (19000/50000 | Loss: 1.6823453903198242, Acc: 0.6625654101371765): 39%|██████████▍ | 19301/50000 [7:34:52<11:40:44, 1.37s/it] about 4 years ago
merges.txt

514 kB

Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1286/50000 [29:40<20:20:20, 1.50s/it] about 4 years ago
push_to_hub.sh

84 Bytes

Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1286/50000 [29:40<20:20:20, 1.50s/it] about 4 years ago
pytorch_model.bin

499 MB
xet

Step... (19000/50000 | Loss: 1.6823453903198242, Acc: 0.6625654101371765): 39%|██████████▍ | 19301/50000 [7:34:52<11:40:44, 1.37s/it] about 4 years ago
run_mlm_flax_stream.py

35.2 kB

Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1286/50000 [29:40<20:20:20, 1.50s/it] about 4 years ago
run_stream.128.sh

930 Bytes

Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1286/50000 [29:40<20:20:20, 1.50s/it] about 4 years ago
run_stream.512.log

3.72 MB

Step... (19000/50000 | Loss: 1.6823453903198242, Acc: 0.6625654101371765): 39%|██████████▍ | 19301/50000 [7:34:52<11:40:44, 1.37s/it] about 4 years ago
run_stream.512.sh

968 Bytes

Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1286/50000 [29:40<20:20:20, 1.50s/it] about 4 years ago
special_tokens_map.json

239 Bytes

Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1286/50000 [29:40<20:20:20, 1.50s/it] about 4 years ago
tokenizer.json

1.47 MB

Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1286/50000 [29:40<20:20:20, 1.50s/it] about 4 years ago
tokenizer_config.json

292 Bytes

Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1286/50000 [29:40<20:20:20, 1.50s/it] about 4 years ago
vocab.json

855 kB

Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1286/50000 [29:40<20:20:20, 1.50s/it] about 4 years ago