Arduino - Weird behavior reading speaker level input
The amount of charge on the capacitor will change the  value you see on the ADC.

change the circuit to this.







simulate this circuit &ndash; Schematic created using CircuitLab