Improve model card: update paper link, add abstract and BibTeX citation

#3
by nielsr HF Staff - opened
Files changed (1) hide show
  1. README.md +16 -8
README.md CHANGED
@@ -1,27 +1,29 @@
1
  ---
2
- license: mit
 
3
  language:
4
  - en
5
- pipeline_tag: image-to-video
6
  library_name: diffusers
7
- base_model:
8
- - Skywork/SkyReels-V2-I2V-1.3B-540P
9
  ---
 
10
  # Matrix-Game 2.0: An Open-Source, Real-Time, and Streaming Interactive World Model
11
  <div style="display: flex; justify-content: center; gap: 10px;">
12
  <a href="https://github.com/SkyworkAI/Matrix-Game">
13
  <img src="https://img.shields.io/badge/GitHub-100000?style=flat&logo=github&logoColor=white" alt="GitHub">
14
  </a>
15
- <a href="https://github.com/SkyworkAI/Matrix-Game/blob/main/Matrix-Game-2/assets/pdf/report.pdf">
16
- <img src="https://img.shields.io/badge/arXiv-Report-b31b1b?style=flat&logo=arxiv&logoColor=white" alt="report">
17
  </a>
18
  <a href="https://matrix-game-v2.github.io/">
19
  <img src="https://img.shields.io/badge/Project%20Page-grey?style=flat&logo=huggingface&color=FFA500" alt="Project Page">
20
  </a>
21
-
22
-
23
  </div>
24
 
 
 
 
25
  ## 📝 Overview
26
  **Matrix-Game-2.0(1.8B)** is an interactive world model generates long videos on-the-fly via few-step auto-regressive diffusion
27
 
@@ -106,4 +108,10 @@ We are grateful to the broader research community for their open exploration and
106
  ## 📎 Citation
107
  If you find this project useful, please cite our paper:
108
  ```bibtex
 
 
 
 
 
 
109
  ```
 
1
  ---
2
+ base_model:
3
+ - Skywork/SkyReels-V2-I2V-1.3B-540P
4
  language:
5
  - en
 
6
  library_name: diffusers
7
+ license: mit
8
+ pipeline_tag: image-to-video
9
  ---
10
+
11
  # Matrix-Game 2.0: An Open-Source, Real-Time, and Streaming Interactive World Model
12
  <div style="display: flex; justify-content: center; gap: 10px;">
13
  <a href="https://github.com/SkyworkAI/Matrix-Game">
14
  <img src="https://img.shields.io/badge/GitHub-100000?style=flat&logo=github&logoColor=white" alt="GitHub">
15
  </a>
16
+ <a href="https://huggingface.co/papers/2508.13009">
17
+ <img src="https://img.shields.io/badge/Paper-blue?style=flat&logo=huggingface&color=blue" alt="Paper">
18
  </a>
19
  <a href="https://matrix-game-v2.github.io/">
20
  <img src="https://img.shields.io/badge/Project%20Page-grey?style=flat&logo=huggingface&color=FFA500" alt="Project Page">
21
  </a>
 
 
22
  </div>
23
 
24
+ ## Abstract
25
+ Recent advances in interactive video generations have demonstrated diffusion model's potential as world models by capturing complex physical dynamics and interactive behaviors. However, existing interactive world models depend on bidirectional attention and lengthy inference steps, severely limiting real-time performance. Consequently, they are hard to simulate real-world dynamics, where outcomes must update instantaneously based on historical context and current actions. To address this, we present Matrix-Game 2.0, an interactive world model generates long videos on-the-fly via few-step auto-regressive diffusion. Our framework consists of three key components: (1) A scalable data production pipeline for Unreal Engine and GTA5 environments to effectively produce massive amounts (about 1200 hours) of video data with diverse interaction annotations; (2) An action injection module that enables frame-level mouse and keyboard inputs as interactive conditions; (3) A few-step distillation based on the casual architecture for real-time and streaming video generation. Matrix Game 2.0 can generate high-quality minute-level videos across diverse scenes at an ultra-fast speed of 25 FPS. We open-source our model weights and codebase to advance research in interactive world modeling.
26
+
27
  ## 📝 Overview
28
  **Matrix-Game-2.0(1.8B)** is an interactive world model generates long videos on-the-fly via few-step auto-regressive diffusion
29
 
 
108
  ## 📎 Citation
109
  If you find this project useful, please cite our paper:
110
  ```bibtex
111
+ @article{wu2025matrixgame2,
112
+ title={Matrix-Game 2.0: An Open-Source, Real-Time, and Streaming Interactive World Model},
113
+ author={Wu, Zhiyong and Wu, Zhenyu and Zhang, Xingchen and Ji, Hongxin and Wen, Jianjun and Zhao, Yang and Jia, Chengyou and Huang, Jiayu and Zhang, Jiajie and Lin, Jiantao and Lin, Yu and Liu, Lin},
114
+ journal={arXiv preprint arXiv:2508.13009},
115
+ year={2025}
116
+ }
117
  ```