sriggi commited on
Commit
e6d2378
·
verified ·
1 Parent(s): 34b7a7d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +20 -0
README.md CHANGED
@@ -24,3 +24,23 @@ images taken from various radio surveys, including ASKAP-EMU, MeerKAT SMGPS and
24
  - **Domain**: Radio Astronomy
25
  - **License**: GPL 3.0 License
26
  - **Development Process**: Supervised Fine-tuning (SFT) on QA pairs
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
24
  - **Domain**: Radio Astronomy
25
  - **License**: GPL 3.0 License
26
  - **Development Process**: Supervised Fine-tuning (SFT) on QA pairs
27
+
28
+ ## Using the model
29
+ To use this model, you need to install LLaVA-NeXT as described in this repository:
30
+
31
+ `https://github.com/LLaVA-VL/LLaVA-NeXT`
32
+
33
+ LLaVA-NeXT requires an outdated version of the `transformers` library (v4.40.0).
34
+
35
+ To load the model:
36
+
37
+ ```python
38
+ from llava.model.builder import load_pretrained_model
39
+
40
+ tokenizer, model, image_processor, max_length = load_pretrained_model(
41
+ model_name_or_path="inaf-oact-ai/radiollava-7b-qa",
42
+ model_base=None,
43
+ model_name="llava_qwen",
44
+ device_map="auto"
45
+ )
46
+ ```