A demo notebook to perform supervised fine-tuning (SFT) of Mistral-7B can be found here. 🌎
A blog post on how to fine-tune LLMs in 2024 using Hugging Face tooling. 🌎
The Alignment Handbook by Hugging Face includes scripts and recipes to perform supervised fine-tuning (SFT) and direct preference optimization with Mistral-7B. This includes scripts for full fine-tuning, QLoRa on a single GPU as well as multi-GPU fine-tuning.
Causal language modeling task guide