Update README.md
Browse files
README.md
CHANGED
|
@@ -11,6 +11,10 @@ tags:
|
|
| 11 |
|
| 12 |
[TokenCompose_SD14_B](https://mlpc-ucsd.github.io/TokenCompose/) is a [latent text-to-image diffusion model](https://arxiv.org/abs/2112.10752) finetuned from the [**Stable-Diffusion-v1-4**](https://huggingface.co/CompVis/stable-diffusion-v1-4) checkpoint at resolution 512x512 on the [VSR](https://github.com/cambridgeltl/visual-spatial-reasoning) split of [COCO image-caption pairs](https://cocodataset.org/#download) for 24,000 steps with a learning rate of 5e-6. The training objective involves token-level grounding terms in addition to denoising loss for enhanced multi-category instance composition and photorealism. The "_A/B" postfix indicates different finetuning runs of the model using the same above configurations.
|
| 13 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 14 |
# 🧨Example Usage
|
| 15 |
|
| 16 |
We strongly recommend using the [🤗Diffuser](https://github.com/huggingface/diffusers) library to run our model.
|
|
@@ -99,4 +103,13 @@ image.save("cat_and_wine_glass.png")
|
|
| 99 |
</table>
|
| 100 |
|
| 101 |
# 📰 Citation
|
| 102 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 11 |
|
| 12 |
[TokenCompose_SD14_B](https://mlpc-ucsd.github.io/TokenCompose/) is a [latent text-to-image diffusion model](https://arxiv.org/abs/2112.10752) finetuned from the [**Stable-Diffusion-v1-4**](https://huggingface.co/CompVis/stable-diffusion-v1-4) checkpoint at resolution 512x512 on the [VSR](https://github.com/cambridgeltl/visual-spatial-reasoning) split of [COCO image-caption pairs](https://cocodataset.org/#download) for 24,000 steps with a learning rate of 5e-6. The training objective involves token-level grounding terms in addition to denoising loss for enhanced multi-category instance composition and photorealism. The "_A/B" postfix indicates different finetuning runs of the model using the same above configurations.
|
| 13 |
|
| 14 |
+
# 📄 Paper
|
| 15 |
+
|
| 16 |
+
Please follow [this](https://arxiv.org/abs/2312.03626) link.
|
| 17 |
+
|
| 18 |
# 🧨Example Usage
|
| 19 |
|
| 20 |
We strongly recommend using the [🤗Diffuser](https://github.com/huggingface/diffusers) library to run our model.
|
|
|
|
| 103 |
</table>
|
| 104 |
|
| 105 |
# 📰 Citation
|
| 106 |
+
```bibtex
|
| 107 |
+
@misc{wang2023tokencompose,
|
| 108 |
+
title={TokenCompose: Grounding Diffusion with Token-level Supervision},
|
| 109 |
+
author={Zirui Wang and Zhizhou Sha and Zheng Ding and Yilin Wang and Zhuowen Tu},
|
| 110 |
+
year={2023},
|
| 111 |
+
eprint={2312.03626},
|
| 112 |
+
archivePrefix={arXiv},
|
| 113 |
+
primaryClass={cs.CV}
|
| 114 |
+
}
|
| 115 |
+
```
|