About finetuning current SDXL weights by the EQ-SDXL-VAE
You said in intro: "You can try to use this VAE to finetune your sdxl model and expect a better final result, but it may require lot of time to achieve it...". I am still very interesting in utilizing existed model weights. So my question is lot of how? I have ~500k samples and how many iterations are required to align the UNet of SDXL with new latent space?
lot of training time.
ALTHOUGH some reported result is "few k step with a small lora works well"
Your setup is definitely ok
I just thought dataset like LAION-400M needed. Finally it turns out in scale of kilo samples said to be working.
I just thought dataset like LAION-400M needed. Finally it turns out in scale of kilo samples said to be working.
My thought is like danbooru (8M) or CC 12M
and yes, I'm also surprising that few k or just few dozen k is enough