Efficient Continual Learning in Language Models via Thalamically Routed Cortical Columns
Paper
• 2602.22479 • Published
TRC2 (Thalamically Routed Cortical Columns) — trc2-d720-l5
This repo hosts TRC2 checkpoint.
What it does
TRC2 is a decoder-only LM backbone designed for continual learning via sparse thalamic routing to cortical columns and fast corrective pathways. (See the paper for details.)
Files
trc2-d720-l5.pt: weights
Usage
Code to be released near soon on GitHub.