Update README.md
Browse files
README.md
CHANGED
@@ -24,3 +24,23 @@ images taken from various radio surveys, including ASKAP-EMU, MeerKAT SMGPS and
|
|
24 |
- **Domain**: Radio Astronomy
|
25 |
- **License**: GPL 3.0 License
|
26 |
- **Development Process**: Supervised Fine-tuning (SFT) on QA pairs
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
24 |
- **Domain**: Radio Astronomy
|
25 |
- **License**: GPL 3.0 License
|
26 |
- **Development Process**: Supervised Fine-tuning (SFT) on QA pairs
|
27 |
+
|
28 |
+
## Using the model
|
29 |
+
To use this model, you need to install LLaVA-NeXT as described in this repository:
|
30 |
+
|
31 |
+
`https://github.com/LLaVA-VL/LLaVA-NeXT`
|
32 |
+
|
33 |
+
LLaVA-NeXT requires an outdated version of the `transformers` library (v4.40.0).
|
34 |
+
|
35 |
+
To load the model:
|
36 |
+
|
37 |
+
```python
|
38 |
+
from llava.model.builder import load_pretrained_model
|
39 |
+
|
40 |
+
tokenizer, model, image_processor, max_length = load_pretrained_model(
|
41 |
+
model_name_or_path="inaf-oact-ai/radiollava-7b-qa",
|
42 |
+
model_base=None,
|
43 |
+
model_name="llava_qwen",
|
44 |
+
device_map="auto"
|
45 |
+
)
|
46 |
+
```
|