File size: 2,771 Bytes
8f55a5d
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
6127e61
8f55a5d
6127e61
 
 
8f55a5d
6127e61
 
 
 
 
 
8f55a5d
 
 
2ea1a0c
 
6127e61
8f55a5d
2ea1a0c
8f55a5d
 
 
 
2ea1a0c
6127e61
8f55a5d
 
 
 
 
 
 
 
6127e61
 
 
 
 
 
 
8f55a5d
 
b6350c1
8f55a5d
3d0d923
6127e61
8f55a5d
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
---
license: other
license_name: server-side-public-license
license_link: https://www.mongodb.com/legal/licensing/server-side-public-license
tags:
- diffusion
- virtual try-on
- virtual try-off
- image generation
- fashion
- e-commerce
base_model:
- CompVis/stable-diffusion-v1-4
pipeline_tag: image-to-image
library_name: diffusers
---

## TryOffDiff <small>[[Project Page]][project_page]</small>

These models are based on the research papers:
1. _"TryOffDiff: Virtual-Try-Off via High-Fidelity Garment Reconstruction using Diffusion Models"_ [[paper]][paper_arxiv]
2. _"Enhancing Person-to-Person Virtual Try-On with Multi-Garment Virtual Try-Off"_ [[paper]][paper2_arxiv]

Available models:
- `tryoffdiff.pth`: Generates upper-body garments. Fine-tuned on `VITON-HD-train`.
- `tryoffdiffv2_upper.pth`: Generates upper-body garments. Fine-tuned on a subset of `Dress Code-train`.
- `tryoffdiffv2_lower.pth`: Generates lower-body garments. Fine-tuned on a subset of `Dress Code-train`.
- `tryoffdiffv2_dress.pth`: Generates dresses. Fine-tuned on a subset of `Dress Code-train`.
- `tryoffdiffv2_multi.pth`: Generates all three garment types (upper-body, lower-body, dresses). Fine-tuned on the entire `Dress Code-train`.

## Usage

> For a complete running example, see the demo code on [HuggingFace Spaces][hf_spaces].

> For more information on training, inference, and evaluation, refer to the [GitHub repository][github].

## License
TL;DR: Not available for commercial use, unless the FULL source code is shared! \
This project is intended solely for academic research. No commercial benefits are derived from it.
Models are licensed under [Server Side Public License (SSPL)][license]

## Citation
If you use this work, please give a star ⭐ and a citation:
```
@article{velioglu2024tryoffdiff,
  title     = {TryOffDiff: Virtual-Try-Off via High-Fidelity Garment Reconstruction using Diffusion Models},
  author    = {Velioglu, Riza and Bevandic, Petra and Chan, Robin and Hammer, Barbara},
  journal   = {arXiv},
  year      = {2024},
  note      = {\url{https://doi.org/nt3n}}
}
@article{velioglu2025enhancing,
  title     = {Enhancing Person-to-Person Virtual Try-On with Multi-Garment Virtual Try-Off},
  author    = {Velioglu, Riza and Bevandic, Petra and Chan, Robin and Hammer, Barbara},
  journal   = {arXiv},
  year      = {2025},
  note      = {\url{https://doi.org/pn67}}
}
```

[hf_spaces]: https://huggingface.co/spaces/rizavelioglu/tryoffdiff/blob/main/app.py
[project_page]: https://rizavelioglu.github.io/tryoffdiff/
[paper_arxiv]: https://arxiv.org/abs/2411.18350
[paper2_arxiv]: https://arxiv.org/abs/2504.13078
[github]: https://github.com/rizavelioglu/tryoffdiff
[license]: https://www.mongodb.com/legal/licensing/server-side-public-license