Starcoder2-3b fined the same way as https://huggingface.co/bigcode/starcoder2-15b-instruct-v0.1 using https://huggingface.co/datasets/bigcode/self-oss-instruct-sc2-exec-filter-50k
Epochs: 1
Learning Rate: 0.0001
Lora Rank: 8
Batch Size: 16
Evaluation Split: 0
|