license: mit
datasets:
- deepseek-ai/DeepSeek-ProverBench
language:
- en
metrics:
- character
pipeline_tag: text-generation
tags:
- research
Leaf
An open source "prototype" AI model used for AI research.
About this project
Leaf is an "experimental" AI model, utilising PyTorch.
Research
With leaf we've been testing many capabilities of what AI could do.
Starting with a simple "embedded" python dataset, leaf uses only 2700 steps for training (the more steps, the better it learns).
Training Data: {"this is a much longer text that will serve as a simple dataset for our tiny language model. The model will learn to predict the next character based on the previous characters in the sequence."} {"text": "This demonstrates the core idea behind training an autoregressive language model. The quick brown fox jumps over the lazy dog."} {"text": "A journey of a thousand miles begins with a single step. The early bird catches the worm. All that glitters is not gold. A stitch in time saves nine."} {"text": "Where there's a will, there's a way. Look before you leap. You can't make an omelette without breaking a few eggs. Practice makes perfect. Don't count your chickens before they hatch."}
However this result came with the following output:
text that will serve
Then we used JSONL databases from the community, and unfortunatly this was the output:
rimetricE7tich then