Prepare Buffer for Inverse FFT
Normally a buffer of N points of data in the frequency domain covers, much like a two's complement number, -N/2 to +N/2-1.  So when you say that it doesn't cover N/2, it probably doesn't matter.  If it does matter and there is a "place" for N/2, just do as Paul suggested and set it to 0.