abideen/Heimer-dpo-TinyLlama-1.1B
Text Generation
•
1B
•
Updated
•
7
TinyLlama-1.1B model aligned on Intel's Orca dataset. Comparison of DPO/IPO/KTO.
Totally Free + Zero Barriers + No Login Required