Image-Text-to-Text
Transformers
Safetensors
English
internvl_chat
feature-extraction
mathematics
reasoning
multi-modal-qa
math-qa
figure-qa
geometry-qa
math-word-problem
textbook-qa
vqa
geometry-diagram
synthetic-scene
chart
plot
scientific-figure
table
function-plot
abstract-scene
puzzle-test
document-image
science
conversational
custom_code
Add files using upload-large-folder tool
Browse files
README.md
CHANGED
|
@@ -23,12 +23,36 @@ We introduce MathCoder-VL, a series of open-source large multimodal models (LMMs
|
|
| 23 |
|-------------------------------------------------------------------|-----------------------------------------------------------------------|
|
| 24 |
| [Mini-InternVL-Chat-2B-V1-5](https://huggingface.co/OpenGVLab/Mini-InternVL-Chat-2B-V1-5) | [MathCoder-VL-2B](https://huggingface.co/MathLLMs/MathCoder-VL-2B) |
|
| 25 |
| [InternVL2-8B](https://huggingface.co/OpenGVLab/InternVL2-8B) | [MathCoder-VL-8B](https://huggingface.co/MathLLMs/MathCoder-VL-8B)|
|
|
|
|
| 26 |
|
| 27 |
|
| 28 |
|
| 29 |
## Usage
|
| 30 |
For training and inference code, please refer to [InternVL](https://github.com/OpenGVLab/InternVL).
|
| 31 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 32 |
### Prompt for TikZ Code Generation
|
| 33 |
|
| 34 |
```
|
|
|
|
| 23 |
|-------------------------------------------------------------------|-----------------------------------------------------------------------|
|
| 24 |
| [Mini-InternVL-Chat-2B-V1-5](https://huggingface.co/OpenGVLab/Mini-InternVL-Chat-2B-V1-5) | [MathCoder-VL-2B](https://huggingface.co/MathLLMs/MathCoder-VL-2B) |
|
| 25 |
| [InternVL2-8B](https://huggingface.co/OpenGVLab/InternVL2-8B) | [MathCoder-VL-8B](https://huggingface.co/MathLLMs/MathCoder-VL-8B)|
|
| 26 |
+
| [InternVL2-8B](https://huggingface.co/OpenGVLab/InternVL2-8B) | [FigCodifier-8B](https://huggingface.co/MathLLMs/FigCodifier)|
|
| 27 |
|
| 28 |
|
| 29 |
|
| 30 |
## Usage
|
| 31 |
For training and inference code, please refer to [InternVL](https://github.com/OpenGVLab/InternVL).
|
| 32 |
|
| 33 |
+
```
|
| 34 |
+
from datasets import load_dataset
|
| 35 |
+
from PIL import Image
|
| 36 |
+
from io import BytesIO
|
| 37 |
+
|
| 38 |
+
mm_mathinstruct = load_dataset("MathLLMs/MM-MathInstruct")
|
| 39 |
+
print(mm_mathinstruct)
|
| 40 |
+
|
| 41 |
+
# show the last image
|
| 42 |
+
img = Image.open(BytesIO(mm_mathinstruct['train'][-1]['image']))
|
| 43 |
+
img.show()
|
| 44 |
+
```
|
| 45 |
+
|
| 46 |
+
It should print:
|
| 47 |
+
```
|
| 48 |
+
DatasetDict({
|
| 49 |
+
train: Dataset({
|
| 50 |
+
features: ['id', 'image', 'question', 'solution', 'image_path'],
|
| 51 |
+
num_rows: 2871988
|
| 52 |
+
})
|
| 53 |
+
})
|
| 54 |
+
```
|
| 55 |
+
|
| 56 |
### Prompt for TikZ Code Generation
|
| 57 |
|
| 58 |
```
|