sdxl-ip-adapter / README.md

Update README.md

93c0da6 verified 12 months ago

5.72 kB

	---
	tags:
	- text-to-image
	- stable-diffusion
	license: apache-2.0
	library_name: diffusers
	---

	# IP-Adapter for SDXL

	This is just a clone from the [original repository](https://huggingface.co/h94/IP-Adapter) with just the SDXL vit-h models and the corresponding image encoder.

	Update: Added IP Adapter for Composition to be able to use multi ip adapters (they need to be in the same repository). Original model: https://huggingface.co/ostris/ip-composition-adapter

	Made to be used with [Image Artisan XL](https://github.com/ZCode-opensource/image-artisan-xl).

	Here's some experiments:

	prompt: `cinematic portrait photo of a woman, against a white background, 4k, highly detailed`

	### ip-adapter_sdxl_vit-h
	\|source\|0% noise\|25% noise\|50% noise\|85% noise\|100% noise\|
	\|---\|---\|---\|---\|---\|---\|
	\|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/ULDAldMoh5g8QqVjJ8wD3.png)\|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/ywPA2CVKl3K9v7Q-FZmsM.png)\|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/8kAfWliJdkHcVGQ2W41aj.png)\|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/upoQFe-sVNc8l-chpoaBe.png)\|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/_l1HBwFKkwPsba8P7K3wp.png)\|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/HvachL6ycm9ZFycWlAUEn.png)\|

	### ip-adapter-plus_sdxl_vit-h
	\|source\|0% noise\|25% noise\|50% noise\|85% noise\|100% noise\|
	\|---\|---\|---\|---\|---\|---\|
	\|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/ULDAldMoh5g8QqVjJ8wD3.png)\|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/a2AnuqOKHHTKT0w07Iypd.png)\|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/hqC11AXCmaRPYM6dEeHUu.png)\|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/ql2MArHyYFAOG32T53WBK.png)\|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/glvJnfnX3pshwnCIYXRAB.png)\|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/z1TItYCQavClCmmImqZ5x.png)\|

	### ip-adapter-plus-face_sdxl_vit-h
	prompt: `cinematic portrait photo of a woman, against a white background, half body shot, closeup, 4k, highly detailed`
	\|source\|0% noise\|25% noise\|50% noise\|85% noise\|100% noise\|
	\|---\|---\|---\|---\|---\|---\|
	\|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/ULDAldMoh5g8QqVjJ8wD3.png)\|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/umdUi6Al90-7y_NaYb2yJ.png)\|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/IdGNZqAzRXbET9mV4ppgf.png)\|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/EJAOi-fyrDNLPXc9LEURd.png)\|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/vEgdBZdNfxreuzPn6nSSc.png)\|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/y39krJCkd2rGRCbJvWWkM.png)\|

	## IP Adapter with multiple images - Instant Lora
	### ip-adapter_sdxl_vit-h

	\|w1\|w2\|w3\|w4\|w5\|bg\|
	\|---\|---\|---\|---\|---\|---\|
	\|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/QftBOflSljQGlV3FXwo07.png)\|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/8e1Z0mWXYb0ocCARQpfDd.png)\|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/c-nRn6nl4hh0yMNjNJdEd.png)\|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/rQkByw6yU9ofij2TH0heR.png)\|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/GLBNsW1cd8JezM-jKShN4.png)\|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/M9oshb8powkDDEpRa8bbY.png)\|

	\|w1(1.0) + w2(1.0)\|w1(0.5) + w2(1.0)\|w1 (1.0) + w2(0.5)\|w1(0.5) + w2(0.5)\|w1(1.0) + w2(1.0) + bg(1.0)\|w1(0.5) + w2(0.5) + bg(1.0)\|w1(0.5) + w2(0.5) + bg(0.5)\|
	\|---\|---\|---\|---\|---\|---\|---\|
	\|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/1cX65n7hwXnhMfpwaKceU.png)\|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/nCV7zBmDY66XZDM4aVS0U.png)\|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/gsDVMMa3k1JbHVzzep4Jv.png)\|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/UC9hwmUPzcB9LNT_DIFyw.png)\|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/7k-R8jvNdYyEvU4WiVURB.png)\|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/R6k15uacJJXuD0-Mk9LO5.png)\|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/wZjvlCg00RLjUJ7ZXfbB-.png)\|

	\|w1+w2+w3\|w1+w2+w3+w4\|w1+w2+w3+w4+w5\|w1+w2+w3+w4+w5+bg\|
	\|---\|---\|---\|---\|
	\|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/GkF_oBRiC7yDvIa7Ggsqo.png)\|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/Hr_1oWzxBA9PwK1CxZgS5.png)\|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/OcLRB-kIi5A4q1SjXWoOK.png)\|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/ph33zaC17sLRpsAgcpyMT.png)\|