Fractional Delay using Polyphase Filter
Just sample a Sinc function at the appropriate phase offset, and truncate the FIR as needed to meet your rectangular window length requirement.  You only need 1 phase for a constant delay while keeping the same sample rate.