lebar-mj commited on
Commit
1194898
·
verified ·
1 Parent(s): a949385

Training in progress, step 250

Browse files
README.md CHANGED
@@ -27,7 +27,7 @@ print(output["generated_text"])
27
 
28
  ## Training procedure
29
 
30
- [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/mlebar-university-of-chicago/huggingface/runs/81xgnibd)
31
 
32
 
33
  This model was trained with GRPO, a method introduced in [DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models](https://huggingface.co/papers/2402.03300).
 
27
 
28
  ## Training procedure
29
 
30
+ [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="150" height="24"/>](https://wandb.ai/mlebar-university-of-chicago/huggingface/runs/rr4qvts9)
31
 
32
 
33
  This model was trained with GRPO, a method introduced in [DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Models](https://huggingface.co/papers/2402.03300).
adapter_config.json CHANGED
@@ -25,10 +25,10 @@
25
  "rank_pattern": {},
26
  "revision": null,
27
  "target_modules": [
28
- "v_proj",
29
- "o_proj",
30
  "k_proj",
31
- "q_proj"
 
 
32
  ],
33
  "target_parameters": null,
34
  "task_type": "CAUSAL_LM",
 
25
  "rank_pattern": {},
26
  "revision": null,
27
  "target_modules": [
 
 
28
  "k_proj",
29
+ "v_proj",
30
+ "q_proj",
31
+ "o_proj"
32
  ],
33
  "target_parameters": null,
34
  "task_type": "CAUSAL_LM",
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c47ac5c418e03790b2784c47d0bd94334e10fed220ae475547f82cbb13603ebc
3
  size 54560368
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d1a699fc6a37a0ffeabc416db2012370e719baa92bb55714a667162c43fef0da
3
  size 54560368
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:3c2707f3bed6e825b1ab329ee8fd67eda78289534601eaeed56112c8ee2b8341
3
  size 7057
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:79e2ec1c0606fbd546153bb5ba34117f0f7d64aa73946dc6a4869e293a71fa49
3
  size 7057
wandb_run_info.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"run_id": "rr4qvts9", "project": "huggingface"}