FineInstructions Pretraining Corpora

Team

community

AI & ML interests

None defined yet.

Recent Activity

AjayP13 updated a dataset less than a minute ago

fineinstructions-pretraining/dclm_baseline_1.0_actual_all

craffel authored a paper about 2 months ago

FineWeb2: One Pipeline to Scale Them All -- Adapting Pre-Training Data Processing to Every Language

craffel authored a paper 3 months ago

The Common Pile v0.1: An 8TB Dataset of Public Domain and Openly Licensed Text

View all activity

fineinstructions-pretraining 's datasets 28

fineinstructions-pretraining/dclm_baseline_1.0_actual_all

Updated less than a minute ago • 5.68k

fineinstructions-pretraining/nemotron_actual_1T_exp

Viewer • Updated 44 minutes ago • 302M

fineinstructions-pretraining/nemotron_fineinstructions_1T

Viewer • Updated about 4 hours ago • 1.23B • 3.53k • 1

fineinstructions-pretraining/nemotron_fineinstructions_1T_raw_3

Viewer • Updated about 4 hours ago • 422M • 2.41k

fineinstructions-pretraining/nemotron_synthetic_1T_exp

Viewer • Updated about 5 hours ago • 448M

fineinstructions-pretraining/nemotron_fineinstructions_1T_raw_2

Viewer • Updated 3 days ago • 412M • 2.69k

fineinstructions-pretraining/nemotron_fineinstructions_1T_raw_1

Viewer • Updated 4 days ago • 15.3M • 3.11k

fineinstructions-pretraining/fineweb_edu_actual_all

Preview • Updated 7 days ago • 14k • 1

fineinstructions-pretraining/nemotron_fineinstructions_1T_raw_0

Viewer • Updated 9 days ago • 427M • 3.13k

fineinstructions-pretraining/nemotron_qa_1T

Viewer • Updated 10 days ago • 972M • 912 • 2

fineinstructions-pretraining/nemotron_wrap_1T

Viewer • Updated 10 days ago • 763M • 1.05k • 1

fineinstructions-pretraining/nemotron_synthetic_1T

Viewer • Updated 10 days ago • 1.13B • 1.06k • 1

fineinstructions-pretraining/nemotron_actual_1T

Viewer • Updated 10 days ago • 746M • 3.63k

fineinstructions-pretraining/ipt_synthetic_all

Viewer • Updated 10 days ago • 40M • 110 • 1

fineinstructions-pretraining/ipt_fineinstructions_all

Viewer • Updated 10 days ago • 84.8M • 451

fineinstructions-pretraining/ipt_actual_all

Viewer • Updated 10 days ago • 40M • 290

fineinstructions-pretraining/nemotron_fineinstructions_1T_raw_5

Viewer • Updated 10 days ago • 811k • 144 • 1

fineinstructions-pretraining/nemotron_fineinstructions_1T_raw_4

Viewer • Updated 10 days ago • 7.45M • 254

fineinstructions-pretraining/longform_fineinstructions_all_raw_0

Viewer • Updated 13 days ago • 100k • 122

fineinstructions-pretraining/ipt_fineinstructions_scored

Viewer • Updated 13 days ago • 9.93k • 141

fineinstructions-pretraining/ipt_fineinstructions_all_exp

Viewer • Updated 13 days ago • 56.3M • 112

fineinstructions-pretraining/ipt_fineinstructions_all_exp_chat

Viewer • Updated 13 days ago • 56.4M • 112

fineinstructions-pretraining/ipt_synthetic_all_exp

Viewer • Updated 13 days ago • 26.6M • 166 • 1

fineinstructions-pretraining/ipt_actual_all_exp

Viewer • Updated 13 days ago • 26.6M • 75

fineinstructions-pretraining/longform_fineinstructions_all

Viewer • Updated 13 days ago • 45.7k • 49

fineinstructions-pretraining/longform_synthetic_all

Viewer • Updated 13 days ago • 27.7k • 39

fineinstructions-pretraining/longform_actual_all

Viewer • Updated 13 days ago • 27.7k • 85

fineinstructions-pretraining/ipt_fineinstructions_all_raw_0

Viewer • Updated 13 days ago • 106M • 625