Locate and light the pilot light: It's often labeled “pilot light,” and can be a small hole in the bottom of the oven, front center near the door opening, or in a back corner. If you don't see it inside the oven, it could be in the back of the broiler compartment.