Frequency response and the effect of phase
Most experiements I've seen reported claim no audible effect for changing the phase of different frequencies. However, there is a minority of people with 'golden ears' who will claim to be able to hear a difference. Try it yourself, and if you can't hear a difference, don't worry about it.