Harish2002 commited on
Commit
818684c
·
verified ·
1 Parent(s): 7e22977

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +18 -9
README.md CHANGED
@@ -1,22 +1,31 @@
1
  ---
2
  license: mit
3
  ---
4
- ## 🧩 Base Model
5
 
6
- - **Base**: [TinyLlama/TinyLlama-1.1B-Chat-v1.0](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0)
7
- - **Fine-tuned using**: [LoRA (Low-Rank Adaptation)](https://arxiv.org/abs/2106.09685)
8
- - **Frameworks**: Hugging Face `transformers`, `peft`, `datasets`, `accelerate`
9
 
10
- ## 🗂️ Dataset
 
 
 
 
 
 
 
11
 
12
- - Custom dataset of 150+ Q&A pairs on CLI topics (git, bash, grep, tar, venv)
13
- - Stored in `cli_questions.json`
14
- - Tokenized and saved in `tokenized_dataset/`
 
 
15
 
16
- ## 🏗️ Fine-Tuning
17
 
 
18
  ```python
19
  base_model = "TinyLlama/TinyLlama-1.1B-Chat-v1.0"
 
20
  lora_config = LoraConfig(
21
  r=16,
22
  lora_alpha=32,
 
1
  ---
2
  license: mit
3
  ---
4
+ # CLI LoRA-TinyLlama
5
 
6
+ Fine-tuned version of [TinyLlama-1.1B-Chat-v1.0](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0) on a custom dataset of CLI-related Q&A using LoRA (Low-Rank Adaptation).
 
 
7
 
8
+ ---
9
+
10
+ ## Base Model
11
+ - **Model**: `TinyLlama/TinyLlama-1.1B-Chat-v1.0`
12
+ - **Technique**: Fine-tuning using [LoRA](https://arxiv.org/abs/2106.09685)
13
+ - **Libraries**: `transformers`, `peft`, `datasets`, `accelerate`
14
+
15
+ ---
16
 
17
+ ## Dataset
18
+ - Custom-made with **150+ Q&A** pairs on:
19
+ - `git`, `bash`, `grep`, `tar`, `venv`
20
+ - Stored in: `cli_questions.json`
21
+ - Tokenized version: `tokenized_dataset/`
22
 
23
+ ---
24
 
25
+ ## Fine-Tuning Configuration
26
  ```python
27
  base_model = "TinyLlama/TinyLlama-1.1B-Chat-v1.0"
28
+
29
  lora_config = LoraConfig(
30
  r=16,
31
  lora_alpha=32,