meta-llama/Llama-3.2-3B-Instruct
Text Generation • 3B • Updated • 4.65M • • 2.04k
Differential transformers
Fine-tuning foundation Llama-3.2-3B-Instruct on medical Q&A using differential attention (In progress). Paper: https://arxiv.org/pdf/2410.05258