TinyGPT (Minimal) — Colab A100 Run
- Tokens: TinyStories 10%
- Context: 512
- Dim: 512
- Layers: 6
- Heads: 8
- Files:
model.safetensors, pytorch_model.bin, tokenizer.json, config.json
A cute little experiment for testing. Lets teach our little robot some fun pentachoron behavior.
