FT2232H with non-standard crystal
Why are USB devices slower than 480 MBit/s

Oh, I see now. If I reduce bit rate I won't be able to hit the allocated time slot. Also USB 2.0 spec requires +/- 500 ppm accuracy.

Oh, well.. back to 2 clocks.