license: mit | |
datasets: | |
- wikipedia | |
language: | |
- en | |
metrics: | |
- perplexity | |
pipeline_tag: fill-mask | |
# Data Efficient Neural Scaling Law | |
Peihao Wang, Rameswar Panda, Zhangyang Wang | |
Pre-trained checkpoints to reproduce ICML 2023 paper [Data Efficient Neural Scaling Law](https://openreview.net/pdf?id=iXYnIz4RRx) |