correlation in an almost independent set of random variables
I think Yury's beautiful example actually answers my question. It shows that $\delta_0$ does not go to 0 as $n\to \infty$. One can probably also use a similar construction to show that the same holds for any $\delta&lt;1/2$.

Thanks Yury!