A second moment proof of the spread lemma

Abstract: This note concerns a well-known result which we term the ``spread lemma,'' which establishes the existence (with high probability) of a desired structure in a random set. The spread lemma was central to two recent celebrated results: (a) the improved bounds of Alweiss, Lovett, Wu, and Zhang (2019) on the Erdős-Rado sunflower conjecture; and (b) the proof of the fractional Kahn--Kalai conjecture by Frankston, Kahn, Narayanan and Park (2019). While the lemma was first proved (and later refined) by delicate counting arguments, alternative proofs have also been given, via Shannon's noiseless coding theorem (Rao, 2019), and also via manipulations of Shannon entropy bounds (Tao, 2020).In this note we present a new proof of the spread lemma, that takes advantage of an explicit recasting of the proof in the language of Bayesian statistical inference. We show that from this viewpoint the proof proceeds in a straightforward and principled probabilistic manner, leading to a truncated second moment calculation which concludes the proof. The proof can also be viewed as a demonstration of the ``planting trick'' introduced by Achlioptas and Coga-Oghlan (2008) in the study of random constraint satisfaction problems.

\section{Introduction}

 In this note, we present a new proof of a known result which we call the ``spread lemma.''  It was the key technical result behind the recent notable improvements (\cite{sunflower_annals}) in the sunflower conjecture posed by Erd\H{o}s and Rado (\cite{erdos1960intersection}). Moreover, it has been also the key technical step behind the proof of the fractional Kahn--Kalai conjecture (\cite{fracKK_annals}), posed by Talagrand (\cite{MR2743011}) as a relaxation of the Kahn--Kalai conjecture (\cite{kahn2007thresholds}).

The spread lemma is proved in \cite{sunflower_annals},
and refined in \cite{fracKK_annals}, by delicate counting arguments. Alternative proofs have also been given by information-theoretic arguments: via the Shannon noiseless coding theorem (\cite{Rao_sunflower}), and also via manipulations of entropic quantities (\cite{Tao_sunflower}).

In this work, we present a new proof of the spread lemma, inspired by ideas from Bayesian statistical inference. We give an explicit statistical interpretation of the setting, and show that this gives rise to a proof of the spread lemma in a principled and straightforward way. The argument can be viewed as an application of the ``planting trick'' introduced by
\cite{Dim_Amin} in the setting of random constraint satisfaction problems. The specific technique employed in this note is most closely related to recent applications of the planting trick in the context of \emph{``all-or-nothing'' phase transitions} in inference problems \cite{coja2022statistical}.

\subsection{The spread lemma} We first describe the spread property in detail. We work on a universe $X$ of $N$ elements.
Let $\mathbf{V}$ denote a random subset of $X$ which includes each element \emph{independently} with probability $p$, and let $\mathbb{Q}_p$ denote the law of $\mathbf{V}$. We now define what it means for a random subset to be \emph{spread}:
\begin{definition}\label{d:spread}
For $R>1$, we say that a random subset $\mathbf{A}\sim \pi$ of $X$ is \emph{$R$-spread} if for all $S \subseteq X$,
	\begin{equation} \label{spread_cond}
	{\pi}(S \subseteq \mathbf{A}) \leq \frac{1}{R^{|S|}}\,.
	\end{equation}
We also say that the probability measure $\pi$ is $R$-spread.
\end{definition}
Hence, a random subset of $X$ is spread, as long as it does not contain any fixed subset with (appropriately defined) significant probability. The definition can also be naturally understood as a set-theoretic analogue of a tail condition for real-valued random variables.  The following is the spread lemma:

\begin{theorem}[spread lemma]\label{thm:main}
Let $\mathscr{A}$ be a collection of subsets of $X$, with each subset of size at most $k$ with $k\ge2$. There exists a universal constant $C$ such that the following holds: if there exists an $R$-spread measure $\pi$ supported on $\mathscr{A}$, then for all $p \ge C(\log k)/R$ the (independent of $\pi$) $p$-biased random subset $\mathbf{V}\sim\mathbb{Q}_p$ contains an element of $\mathscr{A}$ with probability at least $0.9$. \end{theorem}

As mentioned above, proofs of Theorem~\ref{thm:main} (or slight variants thereof) can be found in the prior works  \cite{sunflower_annals, fracKK_annals,Rao_sunflower, Tao_sunflower},  and the result has notable implications.  We refer for instance to \cite{Tao_sunflower} for an exposition of how the improved sunflower bounds \cite{sunflower_annals} can be deduced from Theorem~\ref{thm:main}. The proof of the fractional Kahn--Kalai conjecture, given Theorem~\ref{thm:main}, follows by a linear programming duality argument explained in \cite[Proposition 1.5]{fracKK_annals} (and first observed in \cite{MR2743011}).  In Section~\ref{s:proof} we present our proof of Theorem~\ref{thm:main}, and conclude with some discussions and comparison with prior work in Section~\ref{s:comments}.

\section{Proof of Theorem~\ref{thm:main}}
\label{s:proof}

In this section we present our proof of Theorem~\ref{thm:main}. The core of the argument is the following intermediate result:
\begin{theorem}\label{thm:medium}
Suppose $\mathbf{A}\sim\pi$ is an $R$-spread random subset of $X$. Then there exists a coupling $\mathbb{P}_p$ of $\mathbf{A}\sim\pi$, $\mathbf{A}'\sim\pi$, and $\mathbf{V}\sim\mathbb{Q}_p$ under which  $\mathbf{A},\mathbf{V}$ are marginally independent,  and it holds that
	\begin{equation}\label{iter_exp}
	\mathbb{E}_{\mathbb{P}_p}|\mathbf{A}' \setminus \mathbf{V}|
	\leq \frac{7\mathbb{E}_\pi|\mathbf{A}|}{(pR)^{1/4}} \,.
	\end{equation}
 Moreover,  the marginal law of $\mathbf{A}'$ is the same as that of $\mathbf{A}$,  and therefore
the random set $\mathbf{A}'$ is also $R$-spread.
\end{theorem}

It is well known that Theorem~\ref{thm:medium} (and variants of it) implies Theorem~\ref{thm:main}; for completeness we give an argument for this in \S\ref{sec:implic}. We now proceed with the proof of Theorem~\ref{thm:medium}.

\subsection{The planted model}

We define the following ``planted model'': we first sample a random subset of $X$ according to $\pi$, denoted $\mathbf{A}\sim\pi$, which we view as the (hidden) ``signal'' drawn from the prior $\pi$. We then sample \emph{independently} from $\mathbf{A}$ the ``noise'' $\mathbf{V} \sim \mathbb{Q}_p$. The ``observation'' is $\mathbf{Y}=\mathbf{A} \cup \mathbf{V}$. We then let $\mathbf{A}'$ be sampled from the \emph{posterior distribution} of $\mathbf{A}$ given $\mathbf{Y}$, that is, from the conditional law of $\mathbf{A}$ given $\mathbf{Y}$. We let $\mathbb{P}_p$ denote the resulting {joint} law of $(\mathbf{A},\mathbf{Y},\mathbf{A}')$; this will be the coupling mentioned in the statement of Theorem~\ref{thm:medium}. From Bayes's rule, the marginal laws of $\mathbf{A}$ and $\mathbf{A}'$ under $\mathbb{P}_p$ must be the same, so $\mathbf{A}'$ is also marginally distributed as $\pi$ under $\mathbb{P}_p$. In particular, $\mathbf{A}'$ is also $R$-spread and has the same support as $\mathbf{A}$. Moreover, almost surely under $\mathbb{P}_p$, we must have $\mathbf{A}'\subseteq \mathbf{Y}=\mathbf{A} \cup \mathbf{V}$, therefore $\mathbf{A}' \setminus \mathbf{V} \subseteq \mathbf{A} \cap \mathbf{A}'.$

Now note that to prove Theorem~\ref{thm:medium} we may assume $(pR)^{1/4}>7$; otherwise, since $\mathbf{A}' \setminus \mathbf{V} \subseteq \mathbf{A} \cap \mathbf{A}'$, the result trivially holds. Moreover, since $\mathbf{A}' \setminus \mathbf{V} \subseteq \mathbf{A} \cap \mathbf{A}'$, it suffices to prove
\begin{equation}\label{iter_exp_2}
\mathbb{E}_{\mathbb{P}_p}|\mathbf{A}' \cap \mathbf{A} |
\leq \frac{7\mathbb{E}_\pi|\mathbf{A}|}{(pR)^{1/4}}\,.
\end{equation} From now on we also make the assumption that $\mathbb{E}_\pi|\mathbf{A}|>0$, otherwise \eqref{iter_exp_2} trivially holds.
The following lemma gives a slight simplification of \eqref{iter_exp_2}. Abbreviate $\delta\equiv 1/(pR)^{1/4}$.

\begin{lemma}\label{l:first.reduction}
The bound \eqref{iter_exp_2} (from which Theorem~\ref{thm:medium} follows) is implied if we can show
	\begin{equation}\label{iter_prob}
	\mathbb{P}_p\bigg(
	|\mathbf{A}' \cap \mathbf{A} |\geq
	\delta \mathbb{E}_\pi|\mathbf{A}|
	\,\bigg|\,  \mathcal{F} \bigg)  \le 5\delta
	\end{equation}
where $\mathcal{F}$ denotes the event $\{|\mathbf{A}| \leq \mathbb{E}_\pi|\mathbf{A}| / \delta\}$.

\begin{proof}
First note that \eqref{iter_exp_2} is implied if we can show
	\[\mathbb{P}_p\bigg(
	|\mathbf{A}' \cap \mathbf{A} |\geq \delta \mathbb{E}_\pi|\mathbf{A}|
	\bigg)  \leq 6\delta\,.\]
Indeed, using that $|\mathbf{A}' \cap \mathbf{A} | \le |\mathbf{A}|$, the preceding bound implies
	\[
	\frac{\mathbb{E}_{\mathbb{P}_p}|\mathbf{A}' \cap \mathbf{A} |}{\mathbb{E}_\pi|\mathbf{A}|}
	\le (1-6\delta) \cdot \delta
	+ 6\delta
	\le 7\delta\,,
	\]
having used that marginally $\mathbf{A}\sim\pi$ under $\mathbb{P}_p$. The claim follows by noting that Markov's inequality implies $\mathbb{P}_p(\mathcal{F}^c) \le \delta$, and for any event $\mathcal{E}$ we have $\mathbb{P}_p(\mathcal{E}) \le \mathbb{P}_p(\mathcal{E}\,|\,\mathcal{F}) + \mathbb{P}_p(\mathcal{F}^c)$.
\end{proof}
\end{lemma}

\subsection{The planting trick, and reduction to a second moment bound}
\label{ss:planting.trick}
We will compare the planted model (described above) with the ``null model'' where $\mathbf{Y}=\mathbf{V}\sim\mathbb{Q}_p$. Define
	\begin{equation}\label{e:Z.Y}
	\mathcal{Z}_{\mathbf{Y}}
	=\sum_{A'} \pi(A')
	\frac{\mathbb{P}_p(\mathbf{Y}\,|\,\mathbf{A}=A')}{\mathbb{Q}_p(\mathbf{Y})}
	= \mathbb{E}_{\mathbf{A}\sim\pi}\bigg[
	\frac{\mathbb{P}_p(\mathbf{Y}\,|\,\mathbf{A})}{\mathbb{Q}_p(\mathbf{Y})}\bigg]\,.
	\end{equation}
Let $\mathcal{Z}_{\mathbf{Y}}(\mathbf{A},\delta)$ denote the contribution to the above sum from sets $A'$ with $|\mathbf{A}\cap A'|\ge\delta\mathbb{E}_\pi|\mathbf{A}|$. We use these quantities to re-express the bound \eqref{iter_prob} from Lemma~\ref{l:first.reduction} in terms of the null model:

\begin{lemma}\label{l:planted.to.null}
The bound \eqref{iter_prob}
from Lemma~\ref{l:first.reduction} is equivalent to
    \begin{equation}\label{eq:goal_1}
    \mathbb{E}_{\mathbb{P}_p}\bigg(
    \frac{\mathcal{Z}_{\mathbf{Y}}(\mathbf{A},\delta)}{\mathcal{Z}_{\mathbf{Y}}}
    \,\bigg|\, \mathcal{F}
    \bigg) \leq 5\delta\,.
    \end{equation}

\begin{proof}
Under the planted model, the law of $\mathbf{Y}$ given $\mathbf{A}$ can be written explicitly as
	\[
	\mathbb{P}_p(\mathbf{Y}\,|\,\mathbf{A})
	=\frac{\mathbf{1}\{\mathbf{A}\subseteq \mathbf{Y}\} \mathbb{Q}_p(\mathbf{Y})}{p^{|\mathbf{A}|}}\,.
	\]
The marginal law of $\mathbf{Y}$ under $\mathbb{P}_p$ is therefore given by
	\begin{equation}\label{eq_plantedvsnull_def}
	\mathbb{P}_p(\mathbf{Y})
	= \sum_A\mathbb{P}_p(\mathbf{A}=A,\mathbf{Y})
	=\mathbb{Q}_p(\mathbf{Y}) \sum_A
	\frac{\pi(A)\mathbf{1}\{A\subseteq \mathbf{Y}\} }{p^{|A|}}
	=\mathbb{Q}_p(\mathbf{Y})  \mathcal{Z}_{\mathbf{Y}}\,.
	\end{equation}
Then, by applying Bayes's rule, we obtain
	\[
	\mathbb{P}_p(\mathbf{A}'=A'\,|\,\mathbf{Y})
	= \frac{\mathbb{P}_p(\mathbf{A}=A',\mathbf{Y})}{\mathbb{P}_p(\mathbf{Y})}
	= \frac{1}{\mathcal{Z}_{\mathbf{Y}}}
	\frac{\pi(A')\mathbf{1}\{A'\subseteq \mathbf{Y}\} }{p^{|A'|}}\,.
	\]
It follows that we can express
	\begin{equation}\label{e:cZ.delta}
	\mathbb{P}_p\Big(|\mathbf{A}'\cap\mathbf{A}| \ge \delta\mathbb{E}_\pi|\mathbf{A}|\,\Big|\,\mathbf{A},\mathbf{Y}\Big)
	=\sum_{A'}
\frac{ \mathbf{1}\{|A' \cap \mathbf{A}| \geq \delta \mathbb{E}_\pi|\mathbf{A}|\} }{\mathcal{Z}_{\mathbf{Y}}}
\frac{
 \pi(A')\mathbf{1}\{ A'\subseteq\mathbf{Y}\}}{p^{|A'|}}
	=
	\frac{\mathcal{Z}_{\mathbf{Y}}(\mathbf{A},\delta)}{\mathcal{Z}_{\mathbf{Y}}}\,,
	\end{equation}
and the claim follows.
\end{proof}
\end{lemma}

The next step is our main application of the ``planting trick'': the observation is simply that since \eqref{eq_plantedvsnull_def} says $\mathcal{Z}_{\mathbf{Y}}$ is the Radon--Nikodym derivative between the planted and null laws of $\mathbf{Y}$, it follows that it is unlikely to be small under the planted model. Thus, to show the desired bound \eqref{eq:goal_1}, it suffices to bound the expectation of $\mathcal{Z}_{\mathbf{Y}}(\mathbf{A},\delta)$ under the planted model. The following lemma formalizes this:

\begin{lemma}\label{lem:planting_first}
The bound \eqref{eq:goal_1} from Lemma~\ref{l:planted.to.null} is implied if we can show
	\begin{equation}\label{eq:goal_2}
    \mathbb{E}_{\mathbb{P}_p}\Big(\mathcal{Z}_{\mathbf{Y}}(\mathbf{A},\delta)\Big|
    {\mathcal{F}} \Big)
    \leq 6\delta^2\,.
    \end{equation}

\begin{proof}We saw in \eqref{eq_plantedvsnull_def}
that $\mathbb{P}_p(\mathbf{Y})=\mathbb{Q}_p(\mathbf{Y})\mathcal{Z}_{\mathbf{Y}}$, i.e., $\mathcal{Z}_{\mathbf{Y}}$ is the Radon--Nikodym derivative between the planted and null laws of $\mathbf{Y}$. It follows that
	\[
	\mathbb{P}_p( \mathcal{Z}_{\mathbf{Y}} \leq \epsilon )
	=\mathbb{E}_{\mathbb{Q}_p}\bigg( \frac{\mathbb{P}_p(\mathbf{Y})}{\mathbb{Q}_p(\mathbf{Y})} ;
    	\mathcal{Z}_{\mathbf{Y}}\le\epsilon\bigg)
    	= \mathbb{E}_{\mathbb{Q}_p}\Big( \mathcal{Z}_{\mathbf{Y}};
    	\mathcal{Z}_{\mathbf{Y}}\le\epsilon\Big)
    \le\epsilon\,.\]
Setting $\epsilon=6^{1/2}\delta$ and combining with \eqref{eq:goal_2} gives
	\[\mathbb{E}_{\mathbb{P}_p}\bigg(
    \frac{\mathcal{Z}_{\mathbf{Y}}(\mathbf{A},\delta)}{\mathcal{Z}_{\mathbf{Y}}}
    \,\bigg|\,\mathcal{F}\bigg)
	\leq
	\epsilon
	+\frac{\mathbb{E}(
 	\mathcal{Z}_{\mathbf{Y}}(\mathbf{A},\delta)
    \,|\, \mathcal{F})}{\epsilon}
    \le 5\delta\,, \]
where we used that $\mathcal{Z}_{\mathbf{Y}}(\mathbf{A},\delta) \le \mathcal{Z}_{\mathbf{Y}}$. This shows that
\eqref{eq:goal_2} implies \eqref{eq:goal_1}, as claimed.
\end{proof}
\end{lemma}

\subsection{Truncated second moment calculation}\label{sec:trunc}

In this subsection we conclude the proof of Theorem~\ref{thm:medium} by showing that the bound \eqref{eq:goal_2} reduces to a (tractable) truncated second moment calculation:

\begin{lemma}\label{l:truncated.second.mmt}
The bound \eqref{eq:goal_2} from Lemma~\ref{lem:planting_first} is equivalent to
\begin{equation}\label{eq:goal_3}
\sum_{\ell \geq \delta \mathbb{E}_\pi|\mathbf{A}|}
\frac{\pi^{\otimes 2}(|\mathbf{A}_0 \cap \mathbf{A}|=\ell \,|\, \mathcal{F})}{p^\ell}
\leq \frac{6}{(pR)^{1/2}}\,,
\end{equation}
where $\mathbf{A}_0\sim\pi$ is an independent copy of $\mathbf{A}$, so that $(\mathbf{A},\mathbf{A}_0)\sim\pi^{\otimes2}$.

\begin{proof}Suppose under $\mathbb{P}_p$ that $\mathbf{A}_0$ is an independent copy of $\mathbf{A}$, so that marginally $(\mathbf{A},\mathbf{A}_0)\sim\pi^{\otimes2}$ as in the statement of the lemma.
By the definition \eqref{e:cZ.delta} of $\mathcal{Z}_{\mathbf{Y}}(\mathbf{A},\delta)$, the desired bound \eqref{eq:goal_2} can be rewritten as
    \begin{align*}
    \mathbb{E}_{\mathbb{P}_p}\bigg(
    \frac{\mathbf{1}\{|\mathbf{A}_0 \cap \mathbf{A}| \geq \delta \mathbb{E}_\pi|\mathbf{A}|,\mathbf{A}_0\subseteq \mathbf{Y}\}}{p^{|\mathbf{A}_0|}} \,\bigg|\, \mathcal{F} \bigg)
    \le 6\delta^2\,.
    \end{align*}
Recall that $\mathbf{Y}=\mathbf{A} \cup \mathbf{V}, \mathbf{V} \sim \mathbb{Q}_p$. Thus, conditional on $\mathbf{A}$ and $\mathbf{A}_0$, we have $\mathbf{A}_0\subseteq \mathbf{Y}$ with probability $p^{|\mathbf{A}\setminus \mathbf{A}_0|}$. It follows that the above is equivalent to
\begin{align*}
\mathbb{E}_{\mathbf{A}_0, \mathbf{A}} \bigg(
\frac{\mathbf{1}\{ |\mathbf{A}_0 \cap \mathbf{A}| \geq \delta \mathbb{E}_\pi|\mathbf{A}|\} }{
p^{|\mathbf{A}_0 \cap \mathbf{A}|} }
\,\bigg|\, \mathcal{F}\bigg)
\le 6\delta^2\,.
\end{align*} This in turn is equivalent to the stated bound
\eqref{eq:goal_3}.
\end{proof}
\end{lemma}

\begin{proof}[Proof of Theorem~\ref{thm:medium}]
As established in the preceding subsections (Lemmas~\ref{l:first.reduction}--\ref{l:truncated.second.mmt}), it suffices to prove \eqref{eq:goal_3}. Conditional on $\mathbf{A}$, we have
	\[
	\pi\Big(
		|\mathbf{A}_0 \cap \mathbf{A}|=\ell \,\Big|\, \mathbf{A}  \Big)
	= \sum_{S \subseteq \mathbf{A}, |S|=\ell} \pi (\mathbf{A}_0 \cap \mathbf{A}=S
		\,\Big|\, \mathbf{A}  \Big)
	\,.\]
Since $\mathbf{A}_0\sim\pi$ is $R$-spread, it follows from Definition~\ref{d:spread} that
	\[
	\pi\Big(
		\mathbf{A}_0 \cap \mathbf{A} = S \,\Big|\, \mathbf{A}  \Big)
	\le \pi\Big(S\subseteq \mathbf{A}_0 \,\Big|\, \mathbf{A}  \Big)
	= \pi(S\subseteq \mathbf{A}_0)
	\le \frac{1}{R^{|S|}}
	\]
for all $S\subseteq X$. Substituting this bound into the previous expression gives
	\[\pi\Big(
		|\mathbf{A}_0 \cap \mathbf{A}|=\ell \,\Big|\, \mathbf{A}  \Big)
	\le \binom{|\mathbf{A}|}{\ell} \frac{1}{R^{|S|}}
	\le \bigg(\frac{e |\mathbf{A}| }{R\ell} \bigg)^\ell\,,
	\]
where the last step uses a standard bound on the binomial coefficient. Now recall that we want to condition on the event $\mathcal{F}=\{|\mathbf{A}| \le \mathbb{E}_\pi|\mathbf{A}|/\delta\}$ from Lemma~\ref{l:first.reduction}. It follows that
	\[\pi^{\otimes 2}\Big(|\mathbf{A}_0 \cap \mathbf{A}|=\ell \,\Big|\,\mathcal{F}\Big)
\leq \left(\frac{e  \mathbb{E}_\pi|\mathbf{A}| }{R\ell \delta} \right)^{\ell}\,.\]
Recalling that $\delta=(pR)^{-1/4} \leq 1/7<2/e$, we conclude
\begin{align*}
	&\sum_{\ell \geq \delta \mathbb{E}_\pi|\mathbf{A}|}
	\frac{\pi^{\otimes 2}(|\mathbf{A}_0 \cap \mathbf{A}|=\ell \,|\, \mathcal{F})}{p^\ell}
	\leq \sum_{\ell \geq \delta \mathbb{E}_\pi|\mathbf{A}|}  \left(\frac{e \mathbb{E}_\pi|\mathbf{A}| }{pR\ell \delta}  \right)^{\ell} \\
&\qquad= \sum_{\ell \geq \delta \mathbb{E}_\pi|\mathbf{A}|}  \left(\frac{e \delta^3  \mathbb{E}_\pi|\mathbf{A}| }{\ell} \right)^{\ell}
\leq \sum_{\ell \geq \delta \mathbb{E}_\pi|\mathbf{A}|} \left(e \delta ^2 \right)^{\ell}
\le 2e \delta^2 \leq 6\delta^2\,,
\end{align*}
where we have used that $\ell$ must be a positive integer, and so $\ell\ge1$. This concludes the proof.
\end{proof}

\subsection{Proof of main theorem}
\label{sec:implic}

We now show how to deduce
Theorem~\ref{thm:main} from Theorem~\ref{thm:medium}. As already mentioned above, this argument is known, and we present it here only  in an effort to be self-contained.

\begin{proof}[Proof of Theorem~\ref{thm:main}]
First note that we may assume $\log k\ll R$, since otherwise  for a large enough constant $C$ we will have $C(\log k)/R\ge1$, in which case the theorem holds vacuously. Now let
	\begin{equation}\label{e:def.q}
	q = \frac{(7e)^4}{R} \in(0,1)\,.
	\end{equation}
Let $(\mathbf{V}_i)_{i\ge1}$ be i.i.d.\ samples from $\mathbb{Q}_p$.
Let $\pi_1\equiv\pi$ be the law of $\mathbf{A}_1\equiv\mathbf{A}$.
Applying Theorem~\ref{thm:medium} gives a coupling of $\mathbf{A}_1$ and $\mathbf{V}_1$ with $\mathbf{B}_1\equiv (\mathbf{A}_1)'$ with the bound \eqref{iter_exp}. We then let $\mathbf{A}_2\equiv \mathbf{B}_1\setminus \mathbf{V}_1$, and let $\pi_2$ be the law of $\mathbf{A}_2$  conditional on $\mathbf{V}_1$.  We claim that $\pi_2$ is also $R$-spread, so that this procedure can be iterated to produce an overall coupling $\mathbb{P}$ of $\mathbf{A}_1$, $\mathbf{B}_1=(\mathbf{A}_1)'$, $\mathbf{A}_2=\mathbf{B}_1\setminus\mathbf{V}_1$, $\mathbf{B}_2=(\mathbf{A}_2)'$, and so on, up to $\mathbf{A}_{m+1}=\mathbf{B}_m\setminus\mathbf{V}_m$. Let $\pi_\ell$ denote the law of $\mathbf{A}_\ell$
 conditional on $\mathbf{V}_1,\ldots,\mathbf{V}_{\ell-1}$.  If we suppose inductively that $\pi_{\ell-1}$ is $R$-spread, then we have
	\begin{align*}
	\pi_\ell(S\subseteq \mathbf{A}_\ell)
	&=\mathbb{P}\Big(S\subseteq \mathbf{B}_{\ell-1}\setminus\mathbf{V}_{\ell-1}
		\,\Big|\, (\mathbf{V}_i)_{i \le \ell-1} \Big) \\
	&\le \mathbb{P}\Big(S\subseteq \mathbf{A}_{\ell-1}
		\,\Big|\, (\mathbf{V}_i)_{i \le \ell-1} \Big)
	= \pi_{\ell-1}(S\subseteq \mathbf{A}_{\ell-1}) \le \frac{1}{R^{|S|}}\,,
	\end{align*}
where  the intermediate inequality uses that $\mathbf{B}_{\ell-1}\subseteq\mathbf{A}_{\ell-1}\cup\mathbf{V}_{\ell-1}$, and the last equality uses that $\mathbf{A}_{\ell-1}$ and $\mathbf{V}_{\ell-1}$ are independent.  This verifies our claim that all the $\pi_\ell$ are $R$-spread, which implies that the above procedure is well-defined, and leads to the iterated bound
	\[
	\mathbb{E} |\mathbf{A}_{m+1}|
	=\mathbb{E} |\mathbf{B}_m \setminus \mathbf{V}_m|
	\le \frac{7 \mathbb{E}|\mathbf{A}_m|}{(qR)^{1/4}}
	\le \bigg( \frac{7}{(qR)^{1/4}}\bigg)^m \mathbb{E}|\mathbf{A}_1|
	\le \frac{k}{e^m}\,.\]
In particular, as long as $m\ge \log(10k)$, we have $\mathbb{P}(\mathbf{A}_{m+1}=\emptyset)\ge0.9$.

Recall again that $\pi_{m+1}$ is the law of $\mathbf{A}_{m+1}=\mathbf{B}_m\setminus\mathbf{V}_m$ conditional on $\mathbf{V}_1,\ldots,\mathbf{V}_m$. If $T_{m+1}\in\supp\pi_{m+1}$,  then there exists a sequence
	\[\Big(\mathbf{A}_1(T_{m+1}),\mathbf{B}_1(T_{m+1}),\ldots,
	\mathbf{A}_m(T_{m+1}),\mathbf{B}_m(T_{m+1})\Big)\,,\]
which occurs with positive probability under $\mathbb{P}(\cdot\,|\,\mathbf{V}_1,\ldots,\mathbf{V}_m)$,  such that $T_{m+1}=\mathbf{B}_m(T_{m+1})\setminus \mathbf{V}_m$. Then, for $T_m \equiv \mathbf{B}_m(T_{m+1})\in\supp\pi_m$,  the same reasoning gives a sequence
	\[\Big(\mathbf{A}_1(T_m),\mathbf{B}_1(T_m),\ldots,
	\mathbf{A}_{m-1}(T_m),\mathbf{B}_{m-1}(T_m)\Big)\,,\]
which occurs with positive probability under $\mathbb{P}(\cdot\,|\,\mathbf{V}_1,\ldots,\mathbf{V}_{m-1})$,  such that
$T_m = \mathbf{B}_{m-1}(T_m) \setminus \mathbf{V}_{m-1}$. Let
$T_{m-1}\equiv \mathbf{B}_{m-1}(T_m)$ and iterate to obtain
	\[
	T_{m+1}
	= T_m\setminus \mathbf{V}_m
	= (T_{m-1}\setminus \mathbf{V}_{m-1}) \setminus \mathbf{V}_m
	= T_1 \bigg\backslash \bigg( \bigcup_{i=1}^m \mathbf{V}_i\bigg)
	\]
for some $T_1\in\supp\pi$.  This shows that on the event $\mathbf{A}_{m+1}=T_{m+1}=\emptyset$, the union of the $(\mathbf{V}_i)_{i\le m}$ must cover some element $T_1\in\supp\pi$.

Let $\mathbf{V}$ denote the union of the $(\mathbf{V}_i)_{i\le m}$, and note that $\mathbf{V}\sim\mathbb{Q}_p$ with $p=1-(1-q)^m$. We will take $m\ge \log(10k)$ with
 $m\asymp\log k$, so that the assumptions imply
	\[
	mq \stackrel{\eqref{e:def.q}}{\asymp} \frac{\log k}{R} \ll 1\,.
	\]
It follows then that we can take
	\[
	p=1-(1-q)^m \asymp mq \asymp \frac{\log k}{R}\,,
	\]
which proves the claim.
\end{proof}

\section{Comments}\label{s:comments}

\subsection{Comparison with other proofs of Theorem \ref{thm:main}}

All previous proofs establish Theorem~\ref{thm:main}, by first proving some variant of Theorem~\ref{thm:medium}. The analogues of
Theorem~\ref{thm:medium} in \cite{sunflower_annals,fracKK_annals}
are proved by careful counting arguments.\footnote{\cite{sunflower_annals} provided the first such argument, which was refined by \cite{fracKK_annals} for a stronger bound.} The alternate proof of \cite{Rao_sunflower} constructs an encoding scheme and derives a variant of Theorem~\ref{thm:medium} by the converse of Shannon’s noiseless coding theorem. Another related proof of \cite{Tao_sunflower} does not use counting or encoding arguments, but goes through non-trivial manipulations of Shannon entropy bounds.

The main contribution of our proof is the explicit recasting of the setting in the language of Bayesian statistical inference, which allows us to go back and forth between planted and null models in a useful way. Indeed, our proof is perhaps closest to the ones of \cite{sunflower_annals, fracKK_annals}, which may be regarded in some sense as first moment calculations under the planted model (although they are not stated as such), implemented by delicate counting arguments. By contrast, we transfer the planted model first moment condition to a null model second moment condition (\S\ref{ss:planting.trick}). Since $\mathbb{Q}_p$ is a simple product measure, the latter can be proved by a direct and simple expansion (\S\ref{sec:trunc}).  The framework also gives a new statistical meaning to \eqref{iter_exp_2} as a bound on \emph{the minimum mean squared error} of reconstructing $\mathbf{A}$ from observing $\mathbf{Y}=\mathbf{A} \cup \mathbf{V}$ (see e.g. \cite[Lemma 2]{niles2021all}.)

\subsection{Comparison with direct second moment method}\label{sec:2ndMM}

In this final section, for expository purposes
we compare the calculation of \S\ref{sec:trunc} with a more naive second moment bound under the null model $\mathbb{Q}_p$. This would be perhaps the most standard probabilistic approach to attempt to directly prove Theorem~\ref{thm:main}. Under the null model where $\mathbf{Y}=\mathbf{V}\sim\mathbb{Q}_p$, the quantity $\mathcal{Z}_{\mathbf{Y}}$ from \eqref{e:Z.Y} and \eqref{eq_plantedvsnull_def} can be rewritten as
	\[
	\mathcal{Z}_{\mathbf{V}}
	=
	\sum_A \frac{\pi(A) \mathbf{1}\{A\subseteq \mathbf{V}\}}{p^{|A|}}\,.
	\]
This is a particularly natural quantity if
all sets in $\mathscr{A}$ have the same size $k$
(as is the case in many interesting applications),
and $\pi$ is uniform on $\mathscr{A}$: then $Mp^k\mathcal{Z}_{\mathbf{V}}$ is simply the number of $A\in\mathscr{A}$ that are contained in the random set $\mathbf{V}$.  Abbreviating $\mathcal{Z}\equiv\mathcal{Z}_{\mathbf{V}}$, the classical second moment method would seek to prove
	\begin{equation}\label{sec_mm}
	\frac{\mathbb{E}_{\mathbb{Q}_p}(\mathcal{Z}^2)}{(\mathbb{E}_{\mathbb{Q}_p}\mathcal{Z})^2}
	\leq \frac{10}{9}\,,
	\end{equation}
which would imply $ \mathbb{Q}_p(\mathcal{Z}>0)  \geq 0.9$ by the Paley--Zygmund inequality. The desired result Theorem~\ref{thm:main} would follow, since $\mathcal{Z}>0$ if and only if $\mathbf{V}$ contains at least one $A\in\mathscr{A}$. To evaluate the left-hand side of \eqref{sec_mm}, note that $\mathbb{E}_{\mathbb{Q}_p}\mathcal{Z}=1$, and
	\[
	\mathbb{E}_{\mathbb{Q}_p}(\mathcal{Z}^2)
	=
	\sum_{A,A'} \frac{\pi(A)\pi(A') p^{|A\cup A'|}}{p^{|A|+|A'|}}
	=\sum_{A,A'} \frac{\pi(A)\pi(A') }{p^{|A \cap A'|}}
	\,.\]
Simplifying the last expression, we find that \eqref{sec_mm} is equivalent to
	\begin{equation}\label{2nd_MM}
	\sum_{\ell\ge0}
	\frac{\pi^{\otimes 2}\left( |\mathbf{A}_0 \cap \mathbf{A}|=\ell \right) }{p^{\ell}}
	\le \frac{10}{9}\,,
	\end{equation}
where $(\mathbf{A},\mathbf{A}_0)\sim\pi^{\otimes2}$. Now note that the left-hand side of
\eqref{eq:goal_3} (if we ignore the technical detail of the conditioning on $\mathcal{F}$) is exactly the left-hand side of
\eqref{2nd_MM} restricted to $\ell\ge \delta \mathbb{E}_\pi|\mathbf{A}|$ --- this is the reason we referred to \eqref{eq:goal_3} as a ``truncated second moment bound.''

\subsection{Example of perfect matchings}

We conclude this subsection by explaining that the unrestricted second moment bound \eqref{2nd_MM} does not always hold under the conditions of Theorem~\ref{thm:main}, which shows that the truncation in \eqref{eq:goal_3} is in fact necessary. For this, suppose $\mathscr{A}$ is the set of all perfect matchings of the complete graph $K_n$ (with $n$ even). In this case, straightforward calculations (following e.g.\ \cite[\S7, eq.~(28)]{fracKK_annals}) show that $R \asymp n$. However, we claim that the condition \eqref{2nd_MM} is \emph{not} satisfied for $p \asymp (\log k)/R  \asymp (\log n)/n$.  To this end, let $\mathbf{A}_0,\mathbf{A}\sim\pi^{\otimes2}$ be two independent uniformly perfect matchings, and note that the chance they share at least one edge can be bounded as
	\[
	\pi^{\otimes2}(\mathbf{A}_0\cap\mathbf{A} \ne \emptyset)
	\le \mathbb{E}|\mathbf{A}_0\cap\mathbf{A}|
	=\bigg( \frac{n}{2}\bigg)^2 \bigg/ \binom{n}{2}
	= \frac{1+o_n(1)}2\,.
	\]
Consequently, if we condition on $\mathbf{A}_0=\{e_1,\ldots,e_{n/2}\}$, for each $i$ we have
	\[
	\pi\Big (\mathbf{A}_0\cap\mathbf{A} = \{e_i\} \,\Big|\,
	\mathbf{A}_0=\{e_1,\ldots,e_{n/2}\}\Big)
	\ge \frac{1-o_n(1)}{2n}\,.
	\]
(We have $(1+o_n(1))/n$ probability that $e_i\subseteq\mathbf{A}$;
conditional on this, the probability that $\mathbf{A}_0$ and $\mathbf{A}$ share no additional edges is at least $(1-o_n(1))/2$ by the above observation.) Summing over $1\le i\le n/2$ gives
	\[
	\pi^{\otimes2}(|\mathbf{A}_0\cap\mathbf{A}|=1)\ge \frac{1-o_n(1)}{4}\,.
	\]
 It follows that the $\ell=1$ term in \eqref{2nd_MM}  diverges for $p\asymp (\log n)/n$.

\section*{Acknowledgements} We thank Youngtak Sohn for helpful comments on an earlier version of this work. We also acknowledge the support of Simons-NSF grant DMS-2031883 (E.M., N.S., and I.Z.), the Vannevar Bush Faculty Fellowship ONR-N00014-20-1-2826 (E.M.\ and I.Z.), the Simons Investigator Award 622132 (E.M.), the Sloan Research Fellowship (J.N.W.), and NSF CAREER grant DMS-1940092 (N.S.).

\pagebreak

{\raggedright
\bibliographystyle{alpha}

Combinatorics (math.CO); Discrete Mathematics (cs.DM); Probability (math.PR); Statistics Theory (math.ST)