Extrude face down without disturbing adjacent surfaces
By default the extrusion will follow the face normal (it's orientation). If it's not vertical the extrusion won't be either. To extrude and constrain on the Z axis just press E then Z.

Also, for this kind of faces that stick to the mirror axis, if you enable the Mirror Clipping option it will prevent the creation of a face on the axis itself.