Update README.md
Browse files
README.md
CHANGED
|
@@ -81,7 +81,7 @@ The training pipeline for a single model in InternVL 2.5 is structured across th
|
|
| 81 |
|
| 82 |
We introduce a progressive scaling strategy to align the vision encoder with LLMs efficiently. This approach trains with smaller LLMs first (e.g., 20B) to optimize foundational visual capabilities and cross-modal alignment before transferring the vision encoder to larger LLMs (e.g., 72B) without retraining. This reuse skips intermediate stages for larger models.
|
| 83 |
|
| 84 |
-
 into an easy-to-use pipeline, similar to the Large Language Model (LLM) inference pipeline.
|
|
@@ -537,8 +537,6 @@ If `ImportError` occurs while executing this case, please install the required d
|
|
| 537 |
|
| 538 |
When dealing with multiple images, you can put them all in one list. Keep in mind that multiple images will lead to a higher number of input tokens, and as a result, the size of the context window typically needs to be increased.
|
| 539 |
|
| 540 |
-
question = 'Describe this video in detail.'
|
| 541 |
-
|
| 542 |
```python
|
| 543 |
from lmdeploy import pipeline, TurbomindEngineConfig
|
| 544 |
from lmdeploy.vl import load_image
|
|
@@ -602,7 +600,7 @@ print(sess.response.text)
|
|
| 602 |
LMDeploy's `api_server` enables models to be easily packed into services with a single command. The provided RESTful APIs are compatible with OpenAI's interfaces. Below are an example of service startup:
|
| 603 |
|
| 604 |
```shell
|
| 605 |
-
lmdeploy serve api_server OpenGVLab/InternVL2_5-2B --
|
| 606 |
```
|
| 607 |
|
| 608 |
To use the OpenAI-style interface, you need to install OpenAI:
|
|
|
|
| 81 |
|
| 82 |
We introduce a progressive scaling strategy to align the vision encoder with LLMs efficiently. This approach trains with smaller LLMs first (e.g., 20B) to optimize foundational visual capabilities and cross-modal alignment before transferring the vision encoder to larger LLMs (e.g., 72B) without retraining. This reuse skips intermediate stages for larger models.
|
| 83 |
|
| 84 |
+

|
| 85 |
|
| 86 |
Compared to Qwen2-VL's 1.4 trillion tokens, InternVL2.5-78B uses only 120 billion tokens—less than one-tenth. This strategy minimizes redundancy, maximizes pre-trained component reuse, and enables efficient training for complex vision-language tasks.
|
| 87 |
|
|
|
|
| 164 |
|
| 165 |
### Video Understanding
|
| 166 |
|
| 167 |
+

|
| 168 |
|
| 169 |
## Evaluation on Language Capability
|
| 170 |
|
|
|
|
| 510 |
|
| 511 |
### LMDeploy
|
| 512 |
|
| 513 |
+
LMDeploy is a toolkit for compressing, deploying, and serving LLMs & VLMs.
|
| 514 |
|
| 515 |
```sh
|
| 516 |
+
pip install lmdeploy>=0.6.4
|
| 517 |
```
|
| 518 |
|
| 519 |
LMDeploy abstracts the complex inference process of multi-modal Vision-Language Models (VLM) into an easy-to-use pipeline, similar to the Large Language Model (LLM) inference pipeline.
|
|
|
|
| 537 |
|
| 538 |
When dealing with multiple images, you can put them all in one list. Keep in mind that multiple images will lead to a higher number of input tokens, and as a result, the size of the context window typically needs to be increased.
|
| 539 |
|
|
|
|
|
|
|
| 540 |
```python
|
| 541 |
from lmdeploy import pipeline, TurbomindEngineConfig
|
| 542 |
from lmdeploy.vl import load_image
|
|
|
|
| 600 |
LMDeploy's `api_server` enables models to be easily packed into services with a single command. The provided RESTful APIs are compatible with OpenAI's interfaces. Below are an example of service startup:
|
| 601 |
|
| 602 |
```shell
|
| 603 |
+
lmdeploy serve api_server OpenGVLab/InternVL2_5-2B --server-port 23333
|
| 604 |
```
|
| 605 |
|
| 606 |
To use the OpenAI-style interface, you need to install OpenAI:
|