yspkm/Mistral-7B-Instruct-v0.3-lora-math

Jun 21

Hello,

I want to finetune this model but am stuck. Can you please share your script so that I can finetune this model or get some insight at least just the script not data. Thank You.

Best Regards
Fayaz Ali

yspkm

Owner Jun 25

Hi,

Thanks for reaching out. I have a simple script I worked on last year just out of personal interest:
🔗 https://github.com/yspkm/lora-ft

While it supports various models including Mistral, it might be a bit challenging to use with more recent models since it's been a while.
Feel free to reach out if you run into any issues.

Just to note, my research isn't focused on LLM fine-tuning, but rather on D2NN and PINN for antenna applications in the EEE domain.

Best regards,
Yosep Kim

Fayaz

Jun 25

Thanks You Very Much...

yspkm

Owner Jun 25

My pleasure.

yspkm
/

Mistral-7B-Instruct-v0.3-lora-math

Script Sharing