bertin-project/bertin-base-stepwise-exp-512seqlen at e438145195bd1aa23d6e20dc065ff4564b4f99f8

5.28 GB

3 contributors

Step... (16000/50000 | Loss: 1.6991859674453735, Acc: 0.659552812576294): 34%|█████████▍ | 16847/50000 [6:34:07<17:05:58, 1.86s/it]

e438145 about 4 years ago

configs
Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1286/50000 [29:40<20:20:20, 1.50s/it] about 4 years ago
outputs
Step... (16000/50000 | Loss: 1.6991859674453735, Acc: 0.659552812576294): 34%|█████████▍ | 16847/50000 [6:34:07<17:05:58, 1.86s/it] about 4 years ago
wandb
Step... (16000/50000 | Loss: 1.6991859674453735, Acc: 0.659552812576294): 34%|█████████▍ | 16847/50000 [6:34:07<17:05:58, 1.86s/it] about 4 years ago
.gitattributes

882 Bytes

Step... (14000/50000 | Loss: 1.7139594554901123, Acc: 0.6574689745903015): 29%|███████▋ | 14350/50000 [5:33:22<15:08:11, 1.53s/it] about 4 years ago
README.md

1.48 kB

Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1286/50000 [29:40<20:20:20, 1.50s/it] about 4 years ago
config.json

618 Bytes

Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1286/50000 [29:40<20:20:20, 1.50s/it] about 4 years ago
convert.py

876 Bytes

Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1286/50000 [29:40<20:20:20, 1.50s/it] about 4 years ago
flax_model.msgpack

250 MB
xet

Step... (16000/50000 | Loss: 1.6991859674453735, Acc: 0.659552812576294): 34%|█████████▍ | 16847/50000 [6:34:07<17:05:58, 1.86s/it] about 4 years ago
merges.txt

514 kB

Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1286/50000 [29:40<20:20:20, 1.50s/it] about 4 years ago
push_to_hub.sh

84 Bytes

Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1286/50000 [29:40<20:20:20, 1.50s/it] about 4 years ago
pytorch_model.bin
Detected Pickle imports (4)
- "collections.OrderedDict",
- "torch._utils._rebuild_tensor_v2",
- "torch.LongStorage",
- "torch.FloatStorage"
What is a pickle import?
499 MB
xet

Step... (16000/50000 | Loss: 1.6991859674453735, Acc: 0.659552812576294): 34%|█████████▍ | 16847/50000 [6:34:07<17:05:58, 1.86s/it] about 4 years ago
run_mlm_flax_stream.py

35.2 kB

Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1286/50000 [29:40<20:20:20, 1.50s/it] about 4 years ago
run_stream.128.sh

930 Bytes

Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1286/50000 [29:40<20:20:20, 1.50s/it] about 4 years ago
run_stream.512.log

3.21 MB

Step... (16000/50000 | Loss: 1.6991859674453735, Acc: 0.659552812576294): 34%|█████████▍ | 16847/50000 [6:34:07<17:05:58, 1.86s/it] about 4 years ago
run_stream.512.sh

968 Bytes

Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1286/50000 [29:40<20:20:20, 1.50s/it] about 4 years ago
special_tokens_map.json

239 Bytes

Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1286/50000 [29:40<20:20:20, 1.50s/it] about 4 years ago
tokenizer.json

1.47 MB

Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1286/50000 [29:40<20:20:20, 1.50s/it] about 4 years ago
tokenizer_config.json

292 Bytes

Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1286/50000 [29:40<20:20:20, 1.50s/it] about 4 years ago
vocab.json

855 kB

Step... (1000/50000 | Loss: 1.7686773538589478, Acc: 0.6487793326377869): 3%|▊ | 1286/50000 [29:40<20:20:20, 1.50s/it] about 4 years ago

Detected Pickle imports (4)