USB controllable digital output ports at >100kHz
FTDI is a possible solution if you're ready to write a software which will work with it by D2XX Driver. Also it's relatively expensive.

Another cheap solution is to take any available MCU with hardware USB and write a simple firmware.

If you have any questions about 2nd option - feel free to ask.