Update README.md

README.md

@@ -1,3 +1,26 @@
----
-license: mit
----
+---
+license: mit
+---
+## 🧩 Base Model
+
+- **Base**: [TinyLlama/TinyLlama-1.1B-Chat-v1.0](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v1.0)
+- **Fine-tuned using**: [LoRA (Low-Rank Adaptation)](https://arxiv.org/abs/2106.09685)
+- **Frameworks**: Hugging Face `transformers`, `peft`, `datasets`, `accelerate`
+
+## 🗂️ Dataset
+
+- Custom dataset of 150+ Q&A pairs on CLI topics (git, bash, grep, tar, venv)
+- Stored in `cli_questions.json`
+- Tokenized and saved in `tokenized_dataset/`
+
+## 🏗️ Fine-Tuning
+
+```python
+base_model = "TinyLlama/TinyLlama-1.1B-Chat-v1.0"
+lora_config = LoraConfig(
+    r=16,
+    lora_alpha=32,
+    lora_dropout=0.1,
+    bias="none",
+    task_type="CAUSAL_LM"
+)