MegaMath - a LLM360 Collection

LLM360 's Collections

MegaMath

updated Jul 3, 2025

MegaMath, the largest open math pre-training dataset curated from diverse, math-focused sources, with over 300B tokens.

LLM360/MegaMath

Viewer • Updated Apr 9, 2025 • 217M • 34k • 124
LLM360/MegaMath-Llama-3.2-1B

Text Generation • 1B • Updated Apr 16, 2025 • 12 • • 1
LLM360/MegaMath-Llama-3.2-3B

Text Generation • 3B • Updated Apr 16, 2025 • 9 • 5
MegaMath: Pushing the Limits of Open Math Corpora

Paper • 2504.02807 • Published Apr 3, 2025 • 35