Consistency Decoder Consistency decoder can be used to decode the latents from the denoising UNet in the StableDiffusionPipeline. This decoder was introduced in the DALL-E 3 technical report. The original codebase can be found at openai/consistencydecoder. Inference is only supported for 2 iterations as of now. The pipeline could not have been contributed without the help of madebyollin and mrsteyk from this issue.  ConsistencyDecoderVAE  class