README.md

---
tags:
- text-to-image
- stable-diffusion
license: apache-2.0
library_name: diffusers
---

# IP-Adapter for SDXL

This is just a clone from the [original repository](https://huggingface.co/h94/IP-Adapter) with just the SDXL vit-h models and the corresponding image encoder.

Update: Added IP Adapter for Composition to be able to use multi ip adapters (they need to be in the same repository). Original model: https://huggingface.co/ostris/ip-composition-adapter

Made to be used with [Image Artisan XL](https://github.com/ZCode-opensource/image-artisan-xl).

Here's some experiments:

prompt: `cinematic portrait photo of a woman, against a white background, 4k, highly detailed`

### ip-adapter_sdxl_vit-h
|source|0% noise|25% noise|50% noise|85% noise|100% noise|
|---|---|---|---|---|---|
|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/ULDAldMoh5g8QqVjJ8wD3.png)|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/ywPA2CVKl3K9v7Q-FZmsM.png)|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/8kAfWliJdkHcVGQ2W41aj.png)|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/upoQFe-sVNc8l-chpoaBe.png)|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/_l1HBwFKkwPsba8P7K3wp.png)|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/HvachL6ycm9ZFycWlAUEn.png)|

### ip-adapter-plus_sdxl_vit-h
|source|0% noise|25% noise|50% noise|85% noise|100% noise|
|---|---|---|---|---|---|
|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/ULDAldMoh5g8QqVjJ8wD3.png)|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/a2AnuqOKHHTKT0w07Iypd.png)|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/hqC11AXCmaRPYM6dEeHUu.png)|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/ql2MArHyYFAOG32T53WBK.png)|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/glvJnfnX3pshwnCIYXRAB.png)|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/z1TItYCQavClCmmImqZ5x.png)|

### ip-adapter-plus-face_sdxl_vit-h
prompt: `cinematic portrait photo of a woman, against a white background, half body shot, closeup, 4k, highly detailed`
|source|0% noise|25% noise|50% noise|85% noise|100% noise|
|---|---|---|---|---|---|
|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/ULDAldMoh5g8QqVjJ8wD3.png)|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/umdUi6Al90-7y_NaYb2yJ.png)|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/IdGNZqAzRXbET9mV4ppgf.png)|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/EJAOi-fyrDNLPXc9LEURd.png)|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/vEgdBZdNfxreuzPn6nSSc.png)|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/y39krJCkd2rGRCbJvWWkM.png)|

## IP Adapter with multiple images - Instant Lora
### ip-adapter_sdxl_vit-h

|w1|w2|w3|w4|w5|bg|
|---|---|---|---|---|---|
|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/QftBOflSljQGlV3FXwo07.png)|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/8e1Z0mWXYb0ocCARQpfDd.png)|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/c-nRn6nl4hh0yMNjNJdEd.png)|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/rQkByw6yU9ofij2TH0heR.png)|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/GLBNsW1cd8JezM-jKShN4.png)|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/M9oshb8powkDDEpRa8bbY.png)|

|w1(1.0) + w2(1.0)|w1(0.5) + w2(1.0)|w1 (1.0) + w2(0.5)|w1(0.5) + w2(0.5)|w1(1.0) + w2(1.0) + bg(1.0)|w1(0.5) + w2(0.5) + bg(1.0)|w1(0.5) + w2(0.5) + bg(0.5)|
|---|---|---|---|---|---|---|
|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/1cX65n7hwXnhMfpwaKceU.png)|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/nCV7zBmDY66XZDM4aVS0U.png)|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/gsDVMMa3k1JbHVzzep4Jv.png)|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/UC9hwmUPzcB9LNT_DIFyw.png)|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/7k-R8jvNdYyEvU4WiVURB.png)|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/R6k15uacJJXuD0-Mk9LO5.png)|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/wZjvlCg00RLjUJ7ZXfbB-.png)|

|w1+w2+w3|w1+w2+w3+w4|w1+w2+w3+w4+w5|w1+w2+w3+w4+w5+bg|
|---|---|---|---|
|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/GkF_oBRiC7yDvIa7Ggsqo.png)|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/Hr_1oWzxBA9PwK1CxZgS5.png)|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/OcLRB-kIi5A4q1SjXWoOK.png)|![image/png](https://cdn-uploads.huggingface.co/production/uploads/63df091910678851bb0cd0e0/ph33zaC17sLRpsAgcpyMT.png)|