Note FineMath datasets

HuggingFaceTB/FineMath-Llama-3B

3B • Updated Nov 27, 2025 • 32 • 22

Note Llama 3B trained on a mix of FineMath and FineWeb-Edu: better at math and similar to Llama in reasoning, knowledge and common sense

HuggingFaceTB/finemath-classifier

Text Classification • 0.1B • Updated Dec 19, 2024 • 836 • 16

Note FineMath text classifier to score the mathematical reasoning and educational content

HuggingFaceTB/finemath-ablation-infiwebmath-3plus

3B • Updated Dec 19, 2024 • 13

Note Ablations on FineMath subsets (continual pre-training of base Llama 3.2 3B on 60B tokens)

HuggingFaceTB/finemath-ablation-finemath-infimath-4plus

3B • Updated Dec 19, 2024 • 16 • 2

Note Ablations on FineMath plus3 and plus4 (continual pre-training of base Llama 3.2 3B on 60B tokens)

HuggingFaceTB/finemath-ablation-owm

3B • Updated Dec 19, 2024 • 14

Note Ablations on public math datasets and FW-Edu as a baseline (continual pre-training of base Llama 3.2 3B on 60B tokens)

HuggingFaceTB/finemath-ablation-4plus-160B

3B • Updated Dec 19, 2024 • 21

Note Longer ablation for 160B on a mix of 40% fineweb-edu 60% FineMath and Infiwebmath 3plus / 4plus