Update README.md
Browse files
README.md
CHANGED
@@ -23,7 +23,7 @@ We train and release "Cerule", a tiny yet powerful Vision Lanuage Model based on
|
|
23 |
|
24 |
We utilise highly efficient data selection techniques with:
|
25 |
```
|
26 |
-
- Pretraining stage : 650K images (A LAION
|
27 |
- Finetuning stage : 695K images (SVIT-mix-665K modified for finetuning(Dataset SOON!))
|
28 |
```
|
29 |
The training setup was `4xA100's 80GB` and took ~6 hours to pretrain and ~13 hours to finetune. We modify and adapt the training code from [LLaVA](https://github.com/haotian-liu/LLaVA).
|
|
|
23 |
|
24 |
We utilise highly efficient data selection techniques with:
|
25 |
```
|
26 |
+
- Pretraining stage : 650K images (A LAION Subset)
|
27 |
- Finetuning stage : 695K images (SVIT-mix-665K modified for finetuning(Dataset SOON!))
|
28 |
```
|
29 |
The training setup was `4xA100's 80GB` and took ~6 hours to pretrain and ~13 hours to finetune. We modify and adapt the training code from [LLaVA](https://github.com/haotian-liu/LLaVA).
|