|
--- |
|
license: other |
|
license_name: server-side-public-license |
|
license_link: https://www.mongodb.com/legal/licensing/server-side-public-license |
|
tags: |
|
- diffusion |
|
- virtual try-on |
|
- virtual try-off |
|
- image generation |
|
- fashion |
|
- e-commerce |
|
base_model: |
|
- CompVis/stable-diffusion-v1-4 |
|
pipeline_tag: image-to-image |
|
library_name: diffusers |
|
--- |
|
|
|
## TryOffDiff |
|
|
|
The models proposed in the paper _"TryOffDiff: Virtual-Try-Off via High-Fidelity Garment Reconstruction\\using Diffusion Models"_ |
|
[[paper]](https://arxiv.org/abs/2404.08582) [[project page]][project_page]: |
|
- `tryoffdiff.pth`: The pre-trained StableDiffusion-v1.4 fine-tuned on `VITON-HD-train` dataset. |
|
- `.pth`: A U-Net trained from scratch on `VITON-HD-train` dataset. |
|
- `.pth`: |
|
|
|
|
|
## Usage |
|
|
|
```python |
|
from torchvision.io import read_image |
|
from torchvision.models.detection import MaskRCNN_ResNet50_FPN_Weights |
|
from huggingface_hub import hf_hub_download |
|
|
|
path_onnx = hf_hub_download( |
|
repo_id="rizavelioglu/tryoffdiff", |
|
filename="tryoffdiff.pth", # or one of ["ldm-1", "ldm-2", "ldm-3", ...] |
|
) |
|
|
|
``` |
|
|
|
> Check out the demo code on [HuggingFace Spaces][hf_spaces] for visualizing the output. |
|
|
|
> Also, check out [GitHub repository][project_page] to get more information on |
|
> training, inference, and evaluation. |
|
|
|
### License |
|
TL;DR: Not available for commercial use, unless the FULL source code is shared! \ |
|
This project is intended solely for academic research. No commercial benefits are derived from it. |
|
Models are licensed under [Server Side Public License (SSPL)][license] |
|
|
|
### Citation |
|
If you find this repository useful in your research, please consider giving a star ⭐ and a citation: |
|
``` |
|
@article{velioglu2024tryoffdiff, |
|
title = {TryOffDiff: Virtual-Try-Off via High-Fidelity Garment Reconstruction using Diffusion Models}, |
|
author = {Velioglu, Riza and Bevandic, Petra and Chan, Robin and Hammer, Barbara}, |
|
journal = {arXiv}, |
|
year = {2024}, |
|
note = {\url{https://doi.org/nt3n}} |
|
} |
|
``` |
|
|
|
[hf_spaces]: https://huggingface.co/spaces/rizavelioglu/tryoffdiff |
|
[project_page]: https://rizavelioglu.github.io/tryoffdiff/ |
|
[github]: https://github.com/rizavelioglu/tryoffdiff |
|
[license]: https://www.mongodb.com/legal/licensing/server-side-public-license |
|
|
|
|
