Training in progress, step 100

README.md

@@ -1,37 +1,34 @@
 ---
 license: other
 base_model: stabilityai/stable-code-3b
+tags:
+- generated_from_trainer
 model-index:
 - name: stable-code-3b
   results: []
-datasets:
-- fasterinnerlooper/lcc_csharp
-library_name: peft
-language:
-- code
 ---
 
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
 
 # stable-code-3b
 
-This model is a fine-tuned (LoRA) version of [stabilityai/stable-code-3b](https://huggingface.co/stabilityai/stable-code-3b) trained on the Microsoft/lcc_csharp dataset.
+This model is a fine-tuned version of [stabilityai/stable-code-3b](https://huggingface.co/stabilityai/stable-code-3b) on an unknown dataset.
 
 ## Model description
 
-Stable Code 3B fine-tuned on microsoft/lcc_csharp modified for in-filling
+More information needed
 
 ## Intended uses & limitations
 
-Meant to be used to in-fill C# code
+More information needed
 
 ## Training and evaluation data
 
-[microsoft/lcc_csharp](https://huggingface.co/microsoft/lcc_csharp) modified for in-filling. The dataset is sliced randomly across the entire dataset. One entry in the original dataset maps to one entry in the modified dataset.
+More information needed
 
 ## Training procedure
 
-Trained in a single GPU environment (either A4000 or P5000) with 16GB of RAM.
-
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
@@ -51,4 +48,4 @@ The following hyperparameters were used during training:
 - Transformers 4.36.2
 - Pytorch 2.1.2+cu121
 - Datasets 2.16.1
-- Tokenizers 0.15.1
+- Tokenizers 0.15.1

adapter_config.json

@@ -19,13 +19,13 @@
   "rank_pattern": {},
   "revision": null,
   "target_modules": [
+    "gate_proj",
     "o_proj",
-    "v_proj",
+    "k_proj",
     "up_proj",
-    "q_proj",
+    "v_proj",
     "down_proj",
-    "gate_proj",
-    "k_proj"
+    "q_proj"
   ],
   "task_type": "CAUSAL_LM"
 }

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:f21612564c2cfbe49eed1ad256b95567d4cc292abbc2f5399166991e8f203292
+oid sha256:821af586ba7a2272447a7fb2ad6d31e26f58c317cb638c3d65d95e3b7e56fe4f
 size 50128536

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:49aec3c0a7659316c088ad7250bb3b9741cd44fba92bdc0275a4e23fca8369ad
-size 4792
+oid sha256:fcc85f732e4a7af3d7a3192082ee4455c3d8306c23f0afac854f43833577b8bb
+size 4728