File size: 2,454 Bytes
6a3320e efef1f8 6a3320e 943d9e0 6f9d8d3 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 |
---
library_name: diffusers
pipeline_tag: text-to-image
tags:
- text-to-image
- stable-diffusion
- segmoe
- merge
- moe
- sd1.5
---
This model is a segmoe merge of 2 models from civitAI:
https://civitai.com/models/234898/vixons-fantasy-mix
https://civitai.com/models/43977?modelVersionId=113623
Merged using the great project at: https://github.com/segmind/segmoe
To do something similar you can either follow the guide in readme or you can follow this blogpost: https://huggingface.co/blog/segmoe
The setting I used:
base_model: https://civitai.com/api/download/models/306781
num_experts: 4
moe_layers: all
num_experts_per_tok: 2
type: sd
experts:
- source_model: https://civitai.com/api/download/models/306781
positive_prompt: "cinematic, portrait, photograph, instagram, fashion, movie, macro shot, 8K, RAW, fantastic, ultra high quality"
negative_prompt: " (deformed iris, deformed pupils, semi-realistic, cgi, 3d, render, sketch, cartoon, drawing, anime), text, cropped, out of frame, worst quality, low quality, jpeg artifacts, ugly, duplicate, morbid, mutilated, extra fingers, mutated hands, poorly drawn hands, poorly drawn face, mutation, deformed, blurry, dehydrated, bad anatomy, bad proportions, extra limbs, cloned face, disfigured, gross proportions, malformed limbs, missing arms, missing legs, extra arms, extra legs, fused fingers, too many fingers, long neck"
- source_model: https://civitai.com/api/download/models/113623
positive_prompt: "photo realistic scenes, fantastic view, impressive view, movie scene, 8K, RAW, hyperrealistic, ultra realistic"
negative_prompt: "simple background, duplicate, retro style, low quality, lowest quality, 1980s, 1990s, 2000s, 2005 2006 2007 2008 2009 2010 2011 2012 2013, bad anatomy, bad proportions, extra digits, lowres, username, artist name, error, duplicate, watermark, signature, text, extra digit, fewer digits, worst quality, jpeg artifacts, blurry"
# Useage
!pip install -U segmoe diffusers transformers
from segmoe import SegMoEPipeline
pipeline = SegMoEPipeline("eren23/sd15-FantasyMix-filmGrain-segmoe", device="cuda")
prompt = "fantastic land canvas, knight cat standing next to a purple medieval village wall"
negative_prompt = "nsfw, bad quality, worse quality"
img = pipeline(
prompt=prompt,
negative_prompt=negative_prompt,
height=512,
width=512,
num_inference_steps=30,
guidance_scale=7.5,
).images[0]
img.save("image.png") |