thesantatitan commited on
Commit
8c3fc90
·
verified ·
1 Parent(s): c7e22d7

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +16 -0
README.md CHANGED
@@ -13,4 +13,20 @@ The dataset was curated by re-rendering and cleaning up the Objaverse dataset.
13
  Example image from the dataset:
14
  ![Dataset Example Image](https://huggingface.co/thesantatitan/flux-control-orbit/resolve/main/AGV_vUfbAOm3VgZZlfedG82Nx5HgSwpE9SflOcJMaA5iUJlgqsNmyWeYGrwgQwb1iqwm99NijPQnFF4urUzxFp1j6KtZDqDJp1E7s1IW4gv5D5Fd_a-EIiksnVor.png)
15
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
16
 
 
13
  Example image from the dataset:
14
  ![Dataset Example Image](https://huggingface.co/thesantatitan/flux-control-orbit/resolve/main/AGV_vUfbAOm3VgZZlfedG82Nx5HgSwpE9SflOcJMaA5iUJlgqsNmyWeYGrwgQwb1iqwm99NijPQnFF4urUzxFp1j6KtZDqDJp1E7s1IW4gv5D5Fd_a-EIiksnVor.png)
15
 
16
+ I tried multiple training runs with different hyperparameters, and It seems that the model just learns the output structure at a very high level, but doesn't learn the details.
17
+ Here are some example outputs when asked to generate multiple views of a bird
18
+ ![Bird Multiple views 1](https://huggingface.co/thesantatitan/flux-control-orbit/resolve/main/AGV_vUcYWYEdGywSzW22SdSv3gsHU_eJWSBZfsPNjkj3vOvkz3hNAyofYvyuFK4tea42abeExtPd7jnNF6zmkB5-4hv3111E-_omVOWGR89Pz-_7dAEFOxYxTPvK.png)
19
+ ![Bird Multiple views 2](https://huggingface.co/thesantatitan/flux-control-orbit/resolve/main/validation_2199_e036f00f7f3f74d9b21e-2.png)
20
+
21
+
22
+ Loss graphs for two best training runs
23
+ ![Loss](https://huggingface.co/thesantatitan/flux-control-orbit/resolve/main/Pasted%20Graphic.png)
24
+
25
+ ## Misc Details
26
+
27
+ The training method here is similar to FLUX Depth Control, and FLUX Canny Control.
28
+ The conditioning image is added as extra channels in the input, and the model is asked to denoise the noisy channels.
29
+
30
+ Thanks to [Modal](https://modal.com) for sponsoring the compute for this.
31
+
32