Frequency array feed real values FFT
To get a real signal valued time domain signal: create the negative frequencies as the complex  conjugate of the positive frequencies

To get a complex time domain signal: create negative frequencies by copying the amplitudes of the positive frequencies and applying a random phase.

If you construct the signal in frames you will been apply windowing and overlap to avoid discontinuities at the frame boundaries.