Electret microphone amplification noise
The LM358 is not exactly low noise.
You are using a lot of gain.  48000/180= 266.  The amplification applies to noise as well as the signal.
The bias resistor for the microphone is rather large.  This will also affect how much noise you have.
You haven't mentioned the power supply, but you have 5V for the microphone bias.  The LM358 can operate on 5V, but its input and output ranges are limited.  Input and output voltages have to stay like 1.5V away from the power supply voltages.  If operating on 5V, your input  range is 0V to 3.5V and your output range is about 1V to 3.5V.  If your input is outside of that range you will get distortion (clipping.)  If the input and gain would drive the output outside of that range you will get clipping.
The LM358 is rated for no more than 20mA.  If your headphone impedance is too low you will get distortion.
Your headphone is connected directly to the output of the LM358. If you are using a single sided supply (most likely) then you will have DC flowing through the headphone.  This will cause distortion.  A large capacitor in series between the LM358 and the headphone will block the DC and allow only the sound through.
Electret microphones have an output of several tens of millivolts given a normal speaking voice and a short distance (less than arm's length.  Assuming a signal of 50mV peak to peak, your gain would be trying to output about 13V peak to peak.  If your power supply can't supply that voltage, you will get distortion.
If you are using a single supply, then you must provide a bias of half the supply voltage to the + input of the opamp.  If you leave it a 0V plus your audio then you will get distortion.  This earlier answer to another question shows how.
In a comment, you've added that you are using 5V from an Arduino.  That is an additional source of noise (interference might be a better word.)  The microprocessor will put a lot of "trash" on the 5V source.  Make sure you are using decoupling capacitors on your LM358.


Many of the things I've listed refer to distortion rather than noise.  Many beginners don't know the difference, and call every unexpected sound "noise."  The causes and fixes for noise and distortion are very different.