USB3.0 high speed data lines routing
I would try removing the oscillator and mount it to a different part of the board with some wires. It may affect the oscillators performance but it should help you prove if the oscillator is the issue.