Outputting raw bitstream via USB
2048 bits per second is pretty slow. You might try using a USB to parallel converter and bit-banging one of the pins in software. The FTDI UM245R might do the job. It even has a FIFO if you ever want to try higher bit rates.