Update README.md
Browse files
README.md
CHANGED
|
@@ -26,3 +26,16 @@ Thank you to the [Akash Network](https://akash.network/) for sponsoring this pro
|
|
| 26 |
This is a fine-tune of [Moondream](https://moondream.ai/) (5/20/24 version), a tiny vision language model created by the amazing [vik](https://x.com/vikhyatk).
|
| 27 |
It was fine-tuned on 35,000 image-prompt pairs from the Diffusion DB dataset of Stable Diffusion images.
|
| 28 |
Settings:
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 26 |
This is a fine-tune of [Moondream](https://moondream.ai/) (5/20/24 version), a tiny vision language model created by the amazing [vik](https://x.com/vikhyatk).
|
| 27 |
It was fine-tuned on 35,000 image-prompt pairs from the Diffusion DB dataset of Stable Diffusion images.
|
| 28 |
Settings:
|
| 29 |
+
|
| 30 |
+
- Batch Size: 16
|
| 31 |
+
- Learning Rate: 5e-5
|
| 32 |
+
|
| 33 |
+
Thank you to Akash.net for providing A100s that I used in the process of this project and fine-tuning the model.
|
| 34 |
+
|
| 35 |
+
# Colab
|
| 36 |
+
<a target="_blank" href="https://colab.research.google.com/github/andrewgcodes/autoprompter/blob/main/run_prompt_predictor.ipynb">
|
| 37 |
+
<img src="https://colab.research.google.com/assets/colab-badge.svg" alt="Open In Colab"/>
|
| 38 |
+
</a>
|
| 39 |
+
|
| 40 |
+
# Fine-tuning Script
|
| 41 |
+
Based on the code provided by Vik, [here](https://github.com/andrewgcodes/autoprompter/blob/main/finetunemoondream.py) is what I used to fine-tune.
|