File size: 2,110 Bytes
8e75a9d f08a80b 461ec6b 6d860a5 461ec6b 8e75a9d 461ec6b 8e75a9d 461ec6b 5d8e6d6 461ec6b 6d860a5 461ec6b 6d860a5 461ec6b 6d860a5 461ec6b 6d860a5 461ec6b 6d860a5 461ec6b 8e75a9d 461ec6b |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 |
---
base_model: unsloth/Meta-Llama-3.1-8B-Instruct-bnb-4bit
language:
- en
license: apache-2.0
tags:
- text-generation-inference
- transformers
- unsloth
- llama
- trl
- sft
- safetersors
- pytorch
- coding
- finetuned
datasets:
- Replete-AI/code_bagel
---
# INTRO
we are happy to announce our frist coding model
# Model Card for Model ID
this is a finetune model of [llama3.1]https://llama.meta.com that can perform well in coding
- **Developed by: kshabana
- **Funded by no one
- **Shared by kshabana
- **Model type: safetensors and gguf
- **Language(s) English and coding
- **License:** Apache2.0
- **Finetuned from model [llama3.1-instruct]
### Model Sources
https://huggingface.co/meta-llama/Meta-Llama-3.1-8B-Instruct
- **Dataset Repository:**
https://huggingface.co/datasets/Replete-AI/code_bagel
## Uses
This model is finetuned specifically for coding and it has a 131072 context lingth.
## Bias, Risks, and Limitations
it can some times produce a wrong answers.
### Recommendations
NOTE: you shold have lm studio or ollama to use this model
IN LM-STUDIO: it is recommended to use this model with the defult lm-studio configration.
IN OLLAMA: we will be pushing the model soon to ollama.
## Training Details
model trained with unsloth.
### Training Data
the training dataset that i used: https://huggingface.co/datasets/Replete-AI/code_bagel
## IMPORTANT LINKS
OLLAMA: https://ollama.com
LM-STUDIO: https://lmstudio.ai
llama3.1: instruct: https://huggingface.co/meta-llama/Meta-Llama-3.1-8B-Instruct
dataset: https://huggingface.co/datasets/Replete-AI/code_bagel
This llama model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
[<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth) |