Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,111 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
library_name: hunyuan3d-2
|
| 3 |
+
license: other
|
| 4 |
+
license_name: tencent-hunyuan-community
|
| 5 |
+
license_link: https://huggingface.co/tencent/Hunyuan3D-2/blob/main/LICENSE.txt
|
| 6 |
+
language:
|
| 7 |
+
- en
|
| 8 |
+
- zh
|
| 9 |
+
tags:
|
| 10 |
+
- image-to-3d
|
| 11 |
+
- text-to-3d
|
| 12 |
+
pipeline_tag: image-to-3d
|
| 13 |
+
---
|
| 14 |
+
|
| 15 |
+
<p align="center">
|
| 16 |
+
<img src="https://huggingface.co/tencent/Hunyuan3D-2/resolve/main/assets/images/teaser.jpg">
|
| 17 |
+
</p>
|
| 18 |
+
|
| 19 |
+
<div align="center">
|
| 20 |
+
<a href=https://3d.hunyuan.tencent.com target="_blank"><img src=https://img.shields.io/badge/Hunyuan3D-black.svg?logo=homepage height=22px></a>
|
| 21 |
+
<a href=https://huggingface.co/spaces/tencent/Hunyuan3D-2 target="_blank"><img src=https://img.shields.io/badge/%F0%9F%A4%97%20Demo-276cb4.svg height=22px></a>
|
| 22 |
+
<a href=https://huggingface.co/tencent/Hunyuan3D-2 target="_blank"><img src=https://img.shields.io/badge/%F0%9F%A4%97%20Models-d96902.svg height=22px></a>
|
| 23 |
+
<a href=https://3d-models.hunyuan.tencent.com/ target="_blank"><img src= https://img.shields.io/badge/Page-bb8a2e.svg?logo=github height=22px></a>
|
| 24 |
+
<a href=https://discord.gg/GuaWYwzKbX target="_blank"><img src= https://img.shields.io/badge/Discord-white.svg?logo=discord height=22px></a>
|
| 25 |
+
<a href=https://github.com/Tencent/Hunyuan3D-2/blob/main/assets/report/Tencent_Hunyuan3D_2_0.pdf target="_blank"><img src=https://img.shields.io/badge/Report-b5212f.svg?logo=arxiv height=22px></a>
|
| 26 |
+
</div>
|
| 27 |
+
|
| 28 |
+
|
| 29 |
+
[//]: # ( <a href=# target="_blank"><img src=https://img.shields.io/badge/Report-b5212f.svg?logo=arxiv height=22px></a>)
|
| 30 |
+
|
| 31 |
+
[//]: # ( <a href=# target="_blank"><img src= https://img.shields.io/badge/Colab-8f2628.svg?logo=googlecolab height=22px></a>)
|
| 32 |
+
|
| 33 |
+
[//]: # ( <a href="#"><img alt="PyPI - Downloads" src="https://img.shields.io/pypi/v/mulankit?logo=pypi" height=22px></a>)
|
| 34 |
+
|
| 35 |
+
<br>
|
| 36 |
+
<p align="center">
|
| 37 |
+
“ Living out everyone’s imagination on creating and manipulating 3D assets.”
|
| 38 |
+
</p>
|
| 39 |
+
|
| 40 |
+
This repository contains the models of the paper [Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generation](https://huggingface.co/papers/2501.12202).
|
| 41 |
+
|
| 42 |
+
**Hunyuan3D-2mv** is finetuned from [Hunyuan3D-2](https://huggingface.co/tencent/Hunyuan3D-2) to support multiview controlled shape generation.
|
| 43 |
+
|
| 44 |
+
## 🤗 Get Started with Hunyuan3D 2mv
|
| 45 |
+
|
| 46 |
+
Here is a simple usage:
|
| 47 |
+
|
| 48 |
+
```python
|
| 49 |
+
from hy3dgen.shapegen import Hunyuan3DDiTFlowMatchingPipeline
|
| 50 |
+
pipeline = Hunyuan3DDiTFlowMatchingPipeline.from_pretrained(
|
| 51 |
+
'tencent/Hunyuan3D-2mv',
|
| 52 |
+
subfolder='hunyuan3d-dit-v2-mv',
|
| 53 |
+
use_safetensors=True,
|
| 54 |
+
device='cuda'
|
| 55 |
+
)
|
| 56 |
+
mesh = pipeline(
|
| 57 |
+
image={
|
| 58 |
+
"front": "your front view image.png",
|
| 59 |
+
"left": "your left view image.png",
|
| 60 |
+
"back": "your back view image.png"
|
| 61 |
+
},
|
| 62 |
+
num_inference_steps=30,
|
| 63 |
+
octree_resolution=380,
|
| 64 |
+
num_chunks=20000,
|
| 65 |
+
generator=torch.manual_seed(12345),
|
| 66 |
+
output_type='trimesh'
|
| 67 |
+
)[0]
|
| 68 |
+
```
|
| 69 |
+
|
| 70 |
+
For code and more details on how to use it, refer to the [Github repository](https://github.com/Tencent/Hunyuan3D-2).
|
| 71 |
+
|
| 72 |
+
|
| 73 |
+
|
| 74 |
+
## 🔗 BibTeX
|
| 75 |
+
|
| 76 |
+
If you found this repository helpful, please cite our report:
|
| 77 |
+
|
| 78 |
+
```bibtex
|
| 79 |
+
@misc{hunyuan3d22025tencent,
|
| 80 |
+
title={Hunyuan3D 2.0: Scaling Diffusion Models for High Resolution Textured 3D Assets Generation},
|
| 81 |
+
author={Tencent Hunyuan3D Team},
|
| 82 |
+
year={2025},
|
| 83 |
+
eprint={2501.12202},
|
| 84 |
+
archivePrefix={arXiv},
|
| 85 |
+
primaryClass={cs.CV}
|
| 86 |
+
}
|
| 87 |
+
|
| 88 |
+
@misc{yang2024tencent,
|
| 89 |
+
title={Tencent Hunyuan3D-1.0: A Unified Framework for Text-to-3D and Image-to-3D Generation},
|
| 90 |
+
author={Tencent Hunyuan3D Team},
|
| 91 |
+
year={2024},
|
| 92 |
+
eprint={2411.02293},
|
| 93 |
+
archivePrefix={arXiv},
|
| 94 |
+
primaryClass={cs.CV}
|
| 95 |
+
}
|
| 96 |
+
```
|
| 97 |
+
|
| 98 |
+
## Community Resources
|
| 99 |
+
|
| 100 |
+
Thanks for the contributions of community members, here we have these great extensions of Hunyuan3D 2.0:
|
| 101 |
+
|
| 102 |
+
- [ComfyUI-Hunyuan3DWrapper](https://github.com/kijai/ComfyUI-Hunyuan3DWrapper)
|
| 103 |
+
- [Hunyuan3D-2-for-windows](https://github.com/sdbds/Hunyuan3D-2-for-windows)
|
| 104 |
+
- [📦 A bundle for running on Windows | 整合包](https://github.com/YanWenKun/Comfy3D-WinPortable/releases/tag/r8-hunyuan3d2)
|
| 105 |
+
|
| 106 |
+
## Acknowledgements
|
| 107 |
+
|
| 108 |
+
We would like to thank the contributors to
|
| 109 |
+
the [DINOv2](https://github.com/facebookresearch/dinov2), [Stable Diffusion](https://github.com/Stability-AI/stablediffusion), [FLUX](https://github.com/black-forest-labs/flux), [diffusers](https://github.com/huggingface/diffusers)
|
| 110 |
+
and [HuggingFace](https://huggingface.co) repositories, for their open research and exploration.
|
| 111 |
+
|