Update README.md
Browse files
README.md
CHANGED
@@ -1,3 +1,49 @@
|
|
1 |
-
---
|
2 |
-
license: apache-2.0
|
3 |
-
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: apache-2.0
|
3 |
+
---
|
4 |
+
# MVDream-diffusers Model Card
|
5 |
+
This is a port of https://huggingface.co/MVDream/MVDream into diffusers.
|
6 |
+
|
7 |
+
And get ported weights from https://huggingface.co/ashawkey/mvdream-sd2.1-diffusers
|
8 |
+
In ashawkey's work, UNet did not ported to diffusers.
|
9 |
+
|
10 |
+
This work has been fully ported to diffusers, including UNet.
|
11 |
+
|
12 |
+
## Diffusers
|
13 |
+
```python
|
14 |
+
import torch
|
15 |
+
from diffusers import DiffusionPipeline
|
16 |
+
from diffusers.utils import make_image_grid
|
17 |
+
from PIL import Image
|
18 |
+
|
19 |
+
pipe = DiffusionPipeline.from_pretrained(
|
20 |
+
"kiigii/mvdream-diffusers",
|
21 |
+
torch_dtype=torch.float16,
|
22 |
+
trust_remote_code=True,
|
23 |
+
)
|
24 |
+
pipe.to("cude")
|
25 |
+
|
26 |
+
prompt = "a cute owl 3d model" #
|
27 |
+
|
28 |
+
mv_images = pipe(
|
29 |
+
prompt=prompt,
|
30 |
+
guidance_scale=5,
|
31 |
+
num_inference_steps=30,
|
32 |
+
elevation=0,
|
33 |
+
num_images_per_prompt=1
|
34 |
+
).images
|
35 |
+
mv_grid = make_image_grid(mv_images[:4], 2, 2)
|
36 |
+
mv_grid.save("mv_image.png")
|
37 |
+
```
|
38 |
+
|
39 |
+
## Citation
|
40 |
+
```
|
41 |
+
@article{shi2023MVDream,
|
42 |
+
author = {Shi, Yichun and Wang, Peng and Ye, Jianglong and Mai, Long and Li, Kejie and Yang, Xiao},
|
43 |
+
title = {MVDream: Multi-view Diffusion for 3D Generation},
|
44 |
+
journal = {arXiv:2308.16512},
|
45 |
+
year = {2023},
|
46 |
+
}
|
47 |
+
```
|
48 |
+
## Misuse, Malicious Use, and Out-of-Scope Use
|
49 |
+
The model should not be used to intentionally create or disseminate images that create hostile or alienating environments for people. This includes generating images that people would foreseeably find disturbing, distressing, or offensive; or content that propagates historical or current stereotypes.
|