Assuming we're looking at plots of the time domain I&Q, I'll guess that your multiplication operation is of limited bit width and is causing the quantization.
Not the answer you're looking for? Browse other questions tagged fft modulation window-functions quadrature or ask your own question.
Why is privacy scrambling a standalone block in a communications transmitter?