Silicone does get hot during baking, so use oven mitts to remove the pans from the oven. Let the pans cool for ten or twenty minutes (or longer), then turn the pans upside down and gently peel the pan off the loaf, muffins, or cake (see pictures).. Silicone Pans Are Flexible. Because silicone pans are flexible, you must be careful with the pans while putting them in the oven. Most pans (especially larger pans such as a Bundt pan) need to sit on a cookie sheet to prevent them from slouching.