3-wire dryer plug with mismatched voltages
This is an obsolete type of dryer socket and it should be replaced with a newer 4-prong style that includes both NEUTRAL and GROUND.  Yes you probably should contact an electrician to pull a new wire and hook it up properly.  Since it's clearly not right as it is, you should get it fixed properly.