bertin-project/bertin-base-stepwise-exp-512seqlen at de8489df64dd94501cab55ad6fdceba3a838c47b

5.3 GB

3 contributors

Step... (24000/50000 | Loss: 1.6508632898330688, Acc: 0.6671841740608215): 48%|█████████████ | 24215/50000 [9:36:14<10:45:10, 1.50s/it]

de8489d about 4 years ago

configs
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1286/50000 [29:40<20:20:20, 1.50s/it] about 4 years ago
outputs
Step... (24000/50000 | Loss: 1.6508632898330688, Acc: 0.6671841740608215): 48%|█████████████ | 24215/50000 [9:36:14<10:45:10, 1.50s/it] about 4 years ago
wandb
Step... (24000/50000 | Loss: 1.6508632898330688, Acc: 0.6671841740608215): 48%|█████████████ | 24215/50000 [9:36:14<10:45:10, 1.50s/it] about 4 years ago
.gitattributes

882 Bytes

Step... (14000/50000 | Loss: 1.7139594554901123, Acc: 0.6574689745903015): 29%|███████▋ | 14350/50000 [5:33:22<15:08:11, 1.53s/it] about 4 years ago
README.md

1.48 kB

Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1286/50000 [29:40<20:20:20, 1.50s/it] about 4 years ago
config.json

618 Bytes

Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1286/50000 [29:40<20:20:20, 1.50s/it] about 4 years ago
convert.py

876 Bytes

Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1286/50000 [29:40<20:20:20, 1.50s/it] about 4 years ago
flax_model.msgpack

250 MB
xet

Step... (24000/50000 | Loss: 1.6508632898330688, Acc: 0.6671841740608215): 48%|█████████████ | 24215/50000 [9:36:14<10:45:10, 1.50s/it] about 4 years ago
merges.txt

514 kB

Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1286/50000 [29:40<20:20:20, 1.50s/it] about 4 years ago
push_to_hub.sh

84 Bytes

Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1286/50000 [29:40<20:20:20, 1.50s/it] about 4 years ago
pytorch_model.bin

499 MB
xet

Step... (24000/50000 | Loss: 1.6508632898330688, Acc: 0.6671841740608215): 48%|█████████████ | 24215/50000 [9:36:14<10:45:10, 1.50s/it] about 4 years ago
run_mlm_flax_stream.py

35.2 kB

Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1286/50000 [29:40<20:20:20, 1.50s/it] about 4 years ago
run_stream.128.sh

930 Bytes

Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1286/50000 [29:40<20:20:20, 1.50s/it] about 4 years ago
run_stream.512.log

4.74 MB

Step... (24000/50000 | Loss: 1.6508632898330688, Acc: 0.6671841740608215): 48%|█████████████ | 24215/50000 [9:36:14<10:45:10, 1.50s/it] about 4 years ago
run_stream.512.sh

968 Bytes

Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1286/50000 [29:40<20:20:20, 1.50s/it] about 4 years ago
special_tokens_map.json

239 Bytes

Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1286/50000 [29:40<20:20:20, 1.50s/it] about 4 years ago
tokenizer.json

1.47 MB

Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1286/50000 [29:40<20:20:20, 1.50s/it] about 4 years ago
tokenizer_config.json

292 Bytes

Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1286/50000 [29:40<20:20:20, 1.50s/it] about 4 years ago
vocab.json

855 kB

Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1286/50000 [29:40<20:20:20, 1.50s/it] about 4 years ago