Update README.md
Browse files
README.md
CHANGED
@@ -1,3 +1,27 @@
|
|
1 |
-
---
|
2 |
-
license: apache-2.0
|
3 |
-
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: apache-2.0
|
3 |
+
---
|
4 |
+
|
5 |
+
<video controls autoplay src="https://cdn-uploads.huggingface.co/production/uploads/6310d1226f21f539e52b9d77/7zw2xPWGRpFrwK62CkFqJ.mp4"></video>
|
6 |
+
_Prompt: A young man walks alone by the seaside."_
|
7 |
+
|
8 |
+
__Text2Bricks__ is a fine-tuned [Open Sora](https://github.com/hpcaitech/Open-Sora) model that generates toy brick-style short stop animations.
|
9 |
+
|
10 |
+
|
11 |
+
`text2bricks-360p-32f` is fine-tuned to generated up to 360p/64-frames outputs.
|
12 |
+
|
13 |
+
It was trained on Lambda's [1-Click Clusters](https://lambdalabs.com/service/gpu-cloud/1-click-clusters) in ~1,000 H100 GPU hours. See this [Weights $ Biases report](https://api.wandb.ai/links/lambdalabs/2cbrtx45) for details.
|
14 |
+
|
15 |
+
Extra code and data process steps can be found in this [tutorial](https://github.com/LambdaLabsML/Open-Sora/blob/lambda_bricks/TUTORIAL.md).
|
16 |
+
|
17 |
+
|
18 |
+
# Usage
|
19 |
+
|
20 |
+
Use [Lambda's fork](https://github.com/LambdaLabsML/Open-Sora/tree/lambda_bricks) of Open-Sora.
|
21 |
+
|
22 |
+
```
|
23 |
+
python scripts/inference.py \
|
24 |
+
configs/opensora-v1-1/inference/text2bricks-360p-64f.py \
|
25 |
+
--prompt "A young man walks alone by the seaside." \
|
26 |
+
--num-frames 64
|
27 |
+
```
|