net argument is passed, it will instantiate a StableDiffusionControlNetImg2ImgPipeline
object. The pipeline is set in evaluation mode (model.eval()) by default.  If you get the error message below, you need to finetune the weights for your downstream task:   Copied Some weights of UNet2DConditionModel were not initialized from the model checkpoint at runwayml/stable-diffusion-v1-5 and are newly initialized because the shapes did not match:
- co