skit-ai
/

speechllm-2B

Feature Extraction

speech-language

Model card Files Files and versions

shangeth commited on Jun 4, 2024

Commit

21c6ff5

·

verified ·

1 Parent(s): 477312d

Update README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -97,6 +97,7 @@ model.generate_meta(
 - Checkpoint : 2000 k steps (bs=1)
 - Adapters : r=4, alpha=8
 - lr = 1e-4
 ## Checkpoint Result

 - Checkpoint : 2000 k steps (bs=1)
 - Adapters : r=4, alpha=8
 - lr = 1e-4
+- gradient accumulation steps : 8
 ## Checkpoint Result