Unnamed User
commited on
Commit
·
f8223f5
1
Parent(s):
769e42a
v0.9 release
Browse files- README.md +15 -25
- loras/1600_cseti_1077723_camera-zoomin-10vid_mv2.safetensors +3 -0
- loras/1600_cseti_1720230_camera-crane_up-10vid_mv2.safetensors +3 -0
- loras/1600_cseti_6664682_camera-lateral_right-10vid_mv2.safetensors +3 -0
- loras/1600_cseti_9192119_camera-zoomout-10vid_mv2.safetensors +3 -0
- loras/1600_cseti_9213319_camera-lateral_left-10vid_mv2.safetensors +3 -0
- loras/1600_cseti_9406077_camera-crane_down-10vid_mv2.safetensors +3 -0
- loras/2800_cseti_1093371_camera-zoomin-32f-10vid_mv2.safetensors +3 -0
README.md
CHANGED
|
@@ -7,7 +7,7 @@ tags:
|
|
| 7 |
language:
|
| 8 |
- en
|
| 9 |
---
|
| 10 |
-
- [Basic camera motion LoRAs](#basic-camera-motion-loras)
|
| 11 |
- [Model Description](#model-description)
|
| 12 |
- [File summary](#file-summary)
|
| 13 |
- [General recommendation](#general-recommendation)
|
|
@@ -17,27 +17,29 @@ language:
|
|
| 17 |
- [Walking right view](#walking-right-view)
|
| 18 |
- [Walking left view](#walking-left-view)
|
| 19 |
|
| 20 |
-
# Basic camera motion LoRAs
|
| 21 |
|
| 22 |
## Model Description
|
| 23 |
-
This repository contains a collection of motion LoRAs finetuned on Animatediff v2 models.
|
| 24 |
|
| 25 |
## File summary
|
| 26 |
|
| 27 |
-
| Name
|
| 28 |
-
|
|
| 29 |
-
|
|
| 30 |
-
|
|
| 31 |
-
|
|
| 32 |
-
|
|
|
|
|
|
|
|
|
|
|
| 33 |
|
| 34 |
|
| 35 |
## General recommendation
|
| 36 |
-
|
| 37 |
- These are finetuned on a v2 model. They work also with AnimateLCM but don't work with v3 models
|
| 38 |
-
- They work with SD 1.5
|
| 39 |
-
- Animatediff v3 adapter
|
| 40 |
-
- If you want more motion try
|
| 41 |
- I recommend using the above Base AR (Aspect ratio) for inference however they might work with other ARs too
|
| 42 |
- Try playing with the lora strength and scale multival like increasing the scale multival and lowering the lora strength.
|
| 43 |
- I recommend using IP-Adapter, however it reduces the effect of the mLORAs, so play with the strength. "Ease in out" weight type is a good starting point.
|
|
@@ -45,29 +47,17 @@ This repository contains a collection of motion LoRAs finetuned on Animatediff v
|
|
| 45 |
## Details and examples
|
| 46 |
|
| 47 |
### Walking front view
|
| 48 |
-
- Recommended keywords: front-view, walking
|
| 49 |
-
- LoRA strength: 0.8-1.0
|
| 50 |
-
- scale multival / motion scale: 1.0-1.2
|
| 51 |
|
| 52 |
<video controls src="https://huggingface.co/Cseti/Walking_motion_LoRA_set_for_Animatediff_v2/resolve/main/LoRA-Comparison-upscaleAll-_00054.mp4" title="front view"></video>
|
| 53 |
|
| 54 |
### Walking back view
|
| 55 |
-
- Recommended keywords: back-view, walking
|
| 56 |
-
- LoRA strength: 0.8-1.0
|
| 57 |
-
- scale multival / motion scale: 1.0-1.2
|
| 58 |
|
| 59 |
<video controls src="https://huggingface.co/Cseti/Walking_motion_LoRA_set_for_Animatediff_v2/resolve/main/LoRA-Comparison-upscaleAll-_00063.mp4" title="back view"></video>
|
| 60 |
|
| 61 |
### Walking right view
|
| 62 |
-
- Recommended keywords: side-view, facing right, walking
|
| 63 |
-
- LoRA strength: 0.5-1.0
|
| 64 |
-
- scale multival / motion scale: 1.0-1.2
|
| 65 |
|
| 66 |
<video controls src="https://huggingface.co/Cseti/Walking_motion_LoRA_set_for_Animatediff_v2/resolve/main/LoRA-Comparison-upscaleAll-_00052.mp4" title="right view"></video>
|
| 67 |
|
| 68 |
### Walking left view
|
| 69 |
-
- Recommended keywords: side-view, facing left, walking
|
| 70 |
-
- LoRA strength: 0.5-1.0
|
| 71 |
-
- scale multival / motion scale: 1.0-1.2
|
| 72 |
|
| 73 |
<video controls src="https://huggingface.co/Cseti/Walking_motion_LoRA_set_for_Animatediff_v2/resolve/main/LoRA-Comparison-upscaleAll-_00048.mp4" title="left view"></video>
|
|
|
|
| 7 |
language:
|
| 8 |
- en
|
| 9 |
---
|
| 10 |
+
- [Basic camera motion LoRAs for Animatediff v2 motion models - version 1](#basic-camera-motion-loras-for-animatediff-v2-motion-models---version-1)
|
| 11 |
- [Model Description](#model-description)
|
| 12 |
- [File summary](#file-summary)
|
| 13 |
- [General recommendation](#general-recommendation)
|
|
|
|
| 17 |
- [Walking right view](#walking-right-view)
|
| 18 |
- [Walking left view](#walking-left-view)
|
| 19 |
|
| 20 |
+
# Basic camera motion LoRAs for Animatediff v2 motion models - version 1
|
| 21 |
|
| 22 |
## Model Description
|
| 23 |
+
This repository contains a collection of basic camera motion LoRAs finetuned on Animatediff v2 models. The training process utilized Kijai's [AnimateDiff Motion Director ComfyUI nodes](https://github.com/kijai/ComfyUI-ADMotionDirector). These LoRAs have been tested exclusively in ComfyUI with Kosinkadink's [AnimateDiff-Evolved nodes](https://github.com/Kosinkadink/ComfyUI-AnimateDiff-Evolved), however they may be compatible with other AnimateDiff implementations.
|
| 24 |
|
| 25 |
## File summary
|
| 26 |
|
| 27 |
+
| Name | Compatible Motion Model | Base AR (w/h) | Frames | input videos |
|
| 28 |
+
| ------------------------------------------------------------- | ----------------------- | ------------- | ------ | ------------ |
|
| 29 |
+
| 1600_cseti_9192119_camera-zoomout-10vid_mv2.safetensors | v2 | (3:2) | 16 | 10 |
|
| 30 |
+
| 1600_cseti_1077723_camera-zoomin-10vid_mv2.safetensors | v2 | (3:2) | 16 | 10 |
|
| 31 |
+
| 2800_cseti_1093371_camera-zoomin-32f-10vid_mv2.safetensors | v2 | (3:2) | 32 | 10 |
|
| 32 |
+
| 1600_cseti_6664682_camera-lateral_right-10vid_mv2.safetensors | v2 | (3:2) | 16 | 10 |
|
| 33 |
+
| 1600_cseti_9213319_camera-lateral_left-10vid_mv2.safetensors | v2 | (3:2) | 16 | 10 |
|
| 34 |
+
| 1600_cseti_9406077_camera-crane_down-10vid_mv2.safetensors | v2 | (3:2) | 16 | 10 |
|
| 35 |
+
| 1600_cseti_1720230_camera-crane_up-10vid_mv2.safetensors | v2 | (3:2) | 16 | 10 |
|
| 36 |
|
| 37 |
|
| 38 |
## General recommendation
|
|
|
|
| 39 |
- These are finetuned on a v2 model. They work also with AnimateLCM but don't work with v3 models
|
| 40 |
+
- They work with SD 1.5 checkpoints
|
| 41 |
+
- Animatediff v3 adapter LoRA is recommended regardless they are v2 models
|
| 42 |
+
- If you want more motion try increasing the scale multival
|
| 43 |
- I recommend using the above Base AR (Aspect ratio) for inference however they might work with other ARs too
|
| 44 |
- Try playing with the lora strength and scale multival like increasing the scale multival and lowering the lora strength.
|
| 45 |
- I recommend using IP-Adapter, however it reduces the effect of the mLORAs, so play with the strength. "Ease in out" weight type is a good starting point.
|
|
|
|
| 47 |
## Details and examples
|
| 48 |
|
| 49 |
### Walking front view
|
|
|
|
|
|
|
|
|
|
| 50 |
|
| 51 |
<video controls src="https://huggingface.co/Cseti/Walking_motion_LoRA_set_for_Animatediff_v2/resolve/main/LoRA-Comparison-upscaleAll-_00054.mp4" title="front view"></video>
|
| 52 |
|
| 53 |
### Walking back view
|
|
|
|
|
|
|
|
|
|
| 54 |
|
| 55 |
<video controls src="https://huggingface.co/Cseti/Walking_motion_LoRA_set_for_Animatediff_v2/resolve/main/LoRA-Comparison-upscaleAll-_00063.mp4" title="back view"></video>
|
| 56 |
|
| 57 |
### Walking right view
|
|
|
|
|
|
|
|
|
|
| 58 |
|
| 59 |
<video controls src="https://huggingface.co/Cseti/Walking_motion_LoRA_set_for_Animatediff_v2/resolve/main/LoRA-Comparison-upscaleAll-_00052.mp4" title="right view"></video>
|
| 60 |
|
| 61 |
### Walking left view
|
|
|
|
|
|
|
|
|
|
| 62 |
|
| 63 |
<video controls src="https://huggingface.co/Cseti/Walking_motion_LoRA_set_for_Animatediff_v2/resolve/main/LoRA-Comparison-upscaleAll-_00048.mp4" title="left view"></video>
|
loras/1600_cseti_1077723_camera-zoomin-10vid_mv2.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:388ecea81058f0ae5c995497720834203f4e9c1d270b0472aa7509389e237bae
|
| 3 |
+
size 118348392
|
loras/1600_cseti_1720230_camera-crane_up-10vid_mv2.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:b5cdb3dc07c64d1baaa288c2cc7747cbcfae61a1276632b5e89aead7257764ab
|
| 3 |
+
size 118348392
|
loras/1600_cseti_6664682_camera-lateral_right-10vid_mv2.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:c3d18d62579d78440baea16c97861b071831c3e98282fe2cd06eb0970022846e
|
| 3 |
+
size 118348392
|
loras/1600_cseti_9192119_camera-zoomout-10vid_mv2.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:eeecc684ed8a2abf7051067a9ab2de2e602586e8f7eaf651ed5ea1738555f7e8
|
| 3 |
+
size 118348392
|
loras/1600_cseti_9213319_camera-lateral_left-10vid_mv2.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:f7c660048062a0d87ea05832439a4ed5c85ea9de8127e2132d0d07ac12faee26
|
| 3 |
+
size 118348392
|
loras/1600_cseti_9406077_camera-crane_down-10vid_mv2.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e538b0ad4848fd27240edccf28ace73d5d54949da74a44dcb70738c3a31479f8
|
| 3 |
+
size 118348392
|
loras/2800_cseti_1093371_camera-zoomin-32f-10vid_mv2.safetensors
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:693651ab6a8fb20fcf85339cbebd41650458e1d2fbb4e5af4ec1f13a06bd8a2d
|
| 3 |
+
size 118348392
|