All Adapted Topologies are Equal

Abstract: A number of researchers have introduced topological structures on the set of laws of stochastic processes. A unifying goal of these authors is to strengthen the usual weak topology in order to adequately capture the temporal structure of stochastic processes.Aldous defines an extended weak topology based on the weak convergence of prediction processes. In the economic literature, Hellwig introduced the information topology to study the stability of equilibrium problems. Bion-Nadal and Talay introduce a version of the Wasserstein distance between the laws of diffusion processes. Pflug and Pichler consider the nested distance (and the weak nested topology) to obtain continuity of stochastic multistage programming problems. These distances can be seen as a symmetrization of Lassalle's causal transport problem, but there are also further natural ways to derive a topology from causal transport.Our main result is that all of these seemingly independent approaches define the same topology in finite discrete time. Moreover we show that this 'weak adapted topology' is characterized as the coarsest topology that guarantees continuity of optimal stopping problems for continuous bounded reward functions.

\section{Introduction}
\subsection{Outline}
If some type of natural phenomenon is modelled through a stochastic process, one might expect that the model does not describe reality in an entirely accurate way.
To be able to study the impact of such inaccuracies on the problems one is trying to solve, it makes sense to equip the set of laws of stochastic processes with a suitable notion of distance or topology.

Denoting by ${\overline X} := \S X^N$ the path space (where $X$ is some Polish space and $N \in \mathbb{N}$), the set of laws of stochastic processes is $\Pr {\overline X}$, i.e.\ the set of probability measures on ${\overline X}$.

Clearly, $\Pr {\overline X}$ carries the usual weak topology.
 However, this topology does not respect the time evolution of stochastic processes which has a number of potentially inconvenient consequences: e.g., problems of optimal stopping / utility maximization / stochastic programming are not continuous, arbitrary processes can be approximated by processes which are deterministic after the first period, etc.
 In the following we describe a number of approaches which have been developed by different authors to deal with these (and related) problems.
 Our main result (Theorem \ref{thm:main_simple}) is that all of these approaches actually define the same topology in the present discrete time setup. Moreover, this topology is the weakest topology which allows for continuity of optimal stopping problems.

\subsection{Adapted Wasserstein distances, nested distance}\label{sec:AWIntro}
A number of authors have independently  introduced variants of the Wasserstein distance which take the temporal structure of processes into account: the definition of `iterated Kantorovich distance' by Vershik \cite{Ve70, Ve94} might be seen as a first construction in this direction.
The topic is also considered by R\"uschendorf \cite{Ru85}.
Independently, Pflug and Pflug--Pichler \cite{PfPi12, Pi13,  PfPi14, PfPi15, PfPi16, GlPfPi17} introduce the nested distance and describe the concept's rich potential for the approximation of stochastic multi-period optimization problems.
Lassalle \cite{Las18} considers the `causal transport problem' that leads to a corresponding notion of distance.
Once again independently of these developments, Bion-Nadal  and Talay \cite{BiTa19} define an adapted version of the Wasserstein distance between laws of solutions to SDEs.
Gigli \cite[Chapter 4]{Gi04} introduces a similar distance for measures whose first marginal agrees, see also \cite[Section 12.4]{AmGiSa08}.

To set the stage for describing these `adapted' variants let us fix $p \geq 1$ and recall the definition of the usual $p$-Wassterstein distance.

\let\fancypush\push
\newcommand{\simplepush}[1]{#1_{\#}}
\let\push\simplepush
$(\S X,\rho_\S X)$ is now a Polish metric space. On ${\overline X} = \S X^N$ we use the Polish metric $\rho_{\overline X}((x_t)_t, (y_t)_t) := (\sum_t \rho_\S X(x_t,y_t)^p)^{1/p}$.
Typically, when clear from the context we will omit the subscript for the metric.
We use $(X_t)_t$ to denote the canonical process on ${\overline X}$, i.e.\ $X_t$ is the projection onto the $t$-th factor of ${\overline X} = \S X^N$.
On ${\overline X} \times {\overline X}$ call $X = (X_t)_t$ the projection on the first factor and call $Y = (Y_t)_t$ the projection on the second factor.
For $\mu, \nu \in \Pr {\overline X}$ we denote by $\Cpl \mu \nu$ the set of probability measures $\pi$ on ${\overline X} \times {\overline X}$ for which $X \sim \mu$ and $Y \sim \nu$ under $\pi$, i.e.\ for which the distribution of $X$ under $\pi$ is $\mu$ and that of $Y$ under $\pi$ is $\nu$.
In applications, a particular role is played by Monge couplings.
A Monge coupling from $\mu$ to $\nu$ is a coupling $\pi$ for which $Y = T(X)$ $\pi$-a.s.\ for some Borel mapping $T:{\overline X}\to {\overline X}$ that transports $\mu$ to $\nu$, i.e.\ satisfies $\push T (\mu)=\nu$.

For $\mu, \nu \in \Prp {\overline X}$, i.e.\ for probability measures on ${\overline X}$ with finite $p$-th moment their $p$-Wasserstein distance is
\begin{align}\label{eq:UsualW}
\mathcal W_p(\mu, \nu):=\inf\left\{\E[\pi]{\rho(X,Y)^p}^{1/p}: \pi \in \Couplings(\mu, \nu)\right\} \text{ .}
\end{align}
Following, \cite{Pr07b} the infimum in \eqref{eq:UsualW} remains unchanged  if one minimizes only over Monge couplings in many situations.

To motivate the formal definition of the adapted cousins in \eqref{eq:SCdW} and \eqref{eq:AdW}  below, we start with an informal discussion in terms of Monge mappings:
In probabilistic terms,  the preservation of mass assumption  $\push T (\mu)= \nu$ asserts
\begin{align}\label{MassPreservation}
\big(T_1(X_1, \ldots, X_N), \ldots, T_N(X_1, \ldots, X_N)\big)   \sim  \nu,
\end{align}
which ignores the evolution of $\mu$ and $\nu$ (resp.) in time. Rather it would appear more natural to restrict to  mappings $(T_k)_{k=1}^N$ which are adapted in the sense that $T_k$ depends only on $X_1, \ldots, X_k$.
Adapted Wasserstein distances can be defined  following precisely this intuition, relying on a suitable version of adaptedness on the level of couplings:

The set $\Couplings_c(\mu, \nu)$ of \emph{causal couplings}
  \footnote{Intuitively, at time $t$, given the past $(X_1, \ldots, X_t) $ of $X$,
    the distribution of $Y_t$ does not depend on the future $(X_{t+1}, \ldots, X_N)$ of $X$.
    For measures $\mu$ such that the first marginal of $\mu$ has no atoms, the weak closure of the set of adapted Monge couplings,
    i.e.\ of those $\pi \in \Cpl \mu \nu$ for which $Y=T(X)$ $\pi$-a.s.\ for $T$ adapted,
    is precisely the set of all causal couplings, see \cite{La18}.}
  consists of all $\pi\in \Couplings(\mu, \nu)$ such that
\begin{align}\label{def:adapted.coupling} \pi\big( (Y_1,\dots,Y_t)\in A | X\big)& = \pi\big( (Y_1,\dots,Y_t)\in A | X_1,\dots X_t \big).
\end{align}
for all $t\leq N$ and $A \subseteq \S X^t$ measurable, cf.\ \cite{Las18}.
The set of all \emph{bi-causal} couplings $\Couplings_{bc}(\mu, \nu)$ consists of all $\pi\in\Couplings_c(\mu, \nu)$ such that the distribution of $(Y,X)$ under $\pi$ is also in $\Couplings_c(\nu,\mu)$, i.e.\ that \eqref{def:adapted.coupling} also holds with the roles of $X$ and $Y$ reversed.

The term \emph{causal} was introduced by Lassalle \cite{Las18}, who considers a causal transport problem in which the usual set of couplings is replaced by the set of causal couplings. The resulting concept is not actually a metric as it lacks symmetry, but as suggested by Soumik Pal, this is easily mended and we formally define the \emph{causal -} and \emph{symmetrized-causal $p$-Wasserstein distance}, resp.\ as follows:

For  $\mu, \nu \in \Prp {\overline X}$ set
\begin{align}
  \label{eq:CdW}
    \mathcal {CW}_p(\mu, \nu)  & := \inf\left\{\E[\pi]{\rho(X,Y)^p}^{1/p}: \pi \in \Couplings_c(\mu, \nu)\right\} \\
  \label{eq:SCdW}
    \mathcal{SCW}_p(\mu, \nu) & := \max\pa<\big>{\mathcal {CW}_p(\mu, \nu) ,\, \mathcal {CW}_p(\nu, \mu)} \text{ .}
\intertext{We use the term \emph{adapted Wasserstein distance} for }
  \label{eq:AdW}
    \mathcal {AW}_p(\mu, \nu)  & := \inf\left\{\E[\pi]{\rho(X,Y)^p}^{1/p}: \pi \in \Couplings_{bc}(\mu, \nu)\right\} \text{ .}
\end{align}
  R\"uschendorf \cite{Ru85} refers to $\mathcal {AW}_p$ as `modified Wasserstein distance'.
  Pflug-Pichler \cite[Definition 1]{PfPi12} use the names multi-stage distance of order $p$ and nested distance.
  It can also be considered as a discrete time version of the `Wasserstein-type distance' of Bion-Nadal and Talay \cite{BiTa19}.
  In \cite{BaBaBeEd19a} we use a slightly modified definition of $\mathcal {AW}_p$ which scales better with the number of time-periods $N$ but leads to an equivalent metric (for fixed $p$ and $N$).
  We shall discuss further properties of $\mathcal {AW}_p$ (and in particular the connection with Vershik's iterated Kantorovich distance) in Section \ref{sec:DerErhabeneRaum} below.

\subsection{Hellwig's information topology}
\label{sec:HellwigIntro}

The information topology  introduced by Hellwig in \cite{He96} (as well as Aldous' extended weak topology which we discuss next) is based on the idea that an essential part of the structure of a process is the information that we may deduce about the future behaviour of the process given its behaviour up to current time $t$. For a process whose law is $\mu$, this information is captured by the conditional law $\mathscr L^\mu(X_{t+1}, \dots, X_N | X_1=x_1, \dots, X_t=x_t) $ of $X_{t+1}, \dots, X_N$ given $X_1=x_1, \dots, X_t=x_t$ under $\mu$.

$\mathscr L^\mu(X_{t+1}, \dots, X_N | X_1=x_1, \dots, X_t=x_t) $ is also the disintegration $\mu_{x_1,\dots,x_t}$ of $\mu \in \Pr {\overline X}$ w.r.t.\ the first $t$ coordinates.

Hellwig's \emph{information topology} is the initial topology w.r.t.\ a family of maps $(\mathcal I_t)_{t=1}^{N-1}$ which are defined based on these disintegrations:
\begin{align*}
  \mathcal I_t & : \Pr {\overline X} \rightarrow \Pr { \mathcal X ^ t \times \Pr {\mathcal X ^ {N-t}} } \\
  \mathcal I_t(\mu) & := \push {k^t}(\mu) \\
  k^t(x_1,\dots,x_N) & := (x_1,\dots,x_t,\mu_{x_1,\dots,x_t})
\end{align*}

Equivalently, $\mathcal I_t(\mu)$ is the joint law of
\begin{align*}
  X_1, \dots, X_t, \mathscr L^\mu(X_{t+1}, \dots, X_N | X_1, \dots, X_t)
\end{align*}
under $\mu$, and Hellwig's information topology is therefore the coarsest topology which makes continuous for all $t$ the maps which send a probability $\mu$ to the joint law describing the evolution of the coordinate process up to time $t$ and the prediction about the future behaviour of the coordinate process after $t$.

{\color{black}
\begin{remark}
All the topologies we consider in this paper are second countable. As such they can be characterized by saying which sequences converge. Restated in the language of sequences, the above definition says that a sequence $(\mu_n)_n$ in $\mathcal{P}({\overline X})$ converges in Hellwig's information topology to $\mu\in\mathcal{P}({\overline X})$ if and only if, for every $t$, the sequence $(\mathcal I_t(\mu_n))_n$ converges to $\mathcal I_t(\mu)$ in the usual weak topology on $\Pr { \mathcal X ^ t \times \Pr {\mathcal X ^ {N-t}} }$.
\end{remark}
}

The work of Hellwig \cite{He96} was motivated by questions of stability in dynamic economic models/games; see the related articles \cite{Jo77, VZ02,HeSch02,BarbieGupta}.

\subsection{Aldous' extended weak topology}
Aldous \cite{Al81} introduces a type of convergence for pairs of filtrations and continuous time stochastic processes on them that he calls \emph{extended weak convergence} \cite[Definition 15.2]{Al81}. Restricted to our current setting, his definition can be paraphrased in a similar manner as that of the information topology.
Aldous' idea is to represent a stochastic process with law $\mu$ through the associated \emph{prediction process}\footnote{The  definition of the prediction process goes back at least to Knight \cite{Kn75}.}, that is, the process given by
\begin{align*}
  Z^\mu_0:= \mathscr L(X) = \mu, Z^\mu_1:= \mathscr L^\mu(X | X_1),  \dots, Z^\mu_N:=\mathscr L^\mu(X | X_1, \dots, X_N).
\end{align*}
That is, $(Z^\mu_t)_{t=0}^N$ is a measure-valued martingale that makes increasingly accurate predictions about the full trajectory of the process $X$.

Rather then comparing  the laws of processes directly, the \emph{extended weak topology} is  derived from the weak topology on the corresponding prediction processes (plus the original processes).
I.e.\ formally, the extended weak topology on $\Pr{{\overline X}}$ is the initial topology w.r.t.\ the map
\begin{align*}
  \mathcal E : \Pr {\overline X} \rightarrow \Pr { {\overline X} \times \Pr {\overline X} ^ {N+1} }
\end{align*}
which sends $\mu$ to the joint distribution of
\begin{align*}
   (X, Z^\mu) =\left(  X_1, \dots, X_N, \mu, \mathscr L^\mu(X | X_1), \mathscr L^\mu(X | X_1, X_2), \dots, \mathscr L^\mu(X | X_1, \dots, X_N)\right)
\end{align*}
under $\mu$.

Note that, to stay faithful to Aldous' original definition, we defined $\mathcal E$ to map $\mu$ not just to the law of the prediction process but to the joint law of the original process and its prediction process. One easily checks that the original process may be omitted in our setting without changing the resulting topology.

\subsection{The optimal stopping topology}

The usual weak topology on $\Pr {\overline X}$ is the coarsest topology which makes continuous all the functions
\begin{align*}
  \mu \mapsto {\textstyle \int} f \d\mu
\end{align*}
for $f: {\overline X} \rightarrow \mathbb{R}$ continuous and bounded.

One may follow a similar pattern and look at the coarsest topology which makes continuous the outcomes of all sequential decision procedures.
Perhaps the easiest way to formalize this is to look at optimal stopping problems.
In detail,
write $AC({\overline X})$ for the set of all processes $(L_t)_{t=1}^N$ which are adapted, bounded and satisfy that $x\mapsto L_t(x) $ is continuous for each $t\leq N$.
Write $v^L(\mu)$ for the corresponding value function, given that the process $X$ follows the law $\mu$, i.e.\
\begin{align*}
  v^L(\mu):=\inf\{\E[\mu] {L_\tau}: \tau\leq N\mbox{ is a stopping time}\}.
\end{align*}

The \emph{optimal stopping topology} on $\Pr {\overline X}$ is the coarsest topology which makes the functions
\begin{align*}
  \mu \mapsto v^L(\mu)
\end{align*}
continuous for all $(L_t)_{t=1}^N \in AC({\overline X})$.

\subsection{Main result}

We can now state our main result:

\begin{theorem}
  \label{thm:main_simple}
  Let $(\S X,\rho_\S X)$ be a Polish metric space, where $\rho_\S X$ is a bounded metric and set ${\overline X} := \S X^N$. Then the following topologies on $\Pr {\overline X}$ are equal
  \begin{enumerate}
    \item\label{it:AW}
      the topology induced by $\mathcal A \mathcal W_p$
    \item\label{it:SCW}
      the topology induced by $\mathcal S \mathcal C \mathcal W_p$
    \item\label{it:Hellwig}
      Hellwig's information topology
    \item\label{it:Aldous}
      Aldous' extended weak topology
    \item\label{it:optstop}
      the optimal stopping topology.
  \end{enumerate}
\end{theorem}

The assumption that $\rho_\S X$ is bounded serves only to simplify the statement of the theorem, because in this case the topology induced by $\mathcal W_p$ coincides with the weak topology. For every Polish space there is a bounded complete metric which induces the topology (given any complete metric $\rho_\S X$, replace it by e.g.\ $\min(1,\rho_\S X)$).

\subsubsection{$p$-Wasserstein and unbounded metrics}
There is an analogous statement, Theorem \ref{thm:main} below, which drops the assumption that $\rho_\S X$ is bounded.
To be able to state it, we introduce slight variations of Hellwig's information topology, of Aldous' extended weak topology and of the optimal stopping topology:

In \cite{He96} Hellwig equips the target spaces of $\mathcal I_t$ with the weak topology -- or more precisely he equips $\Pr {\S X^{N-t}}$ with the weak topology, $\S X^t \times \Pr {\S X^{N-t}}$ with the product topology and finally $\Pr {\S X^t \times \Pr {\S X^{N-t}}}$ with the weak topology based on this topology.
One may easily define a $p$-Wasserstein version of Hellwigs information topology by using the recipe \enquote*{replace the weak topology by the $p$-Wasserstein metric everywhere}. Concretely, if we restrict $\mathcal I_t$ to $\Prp {\overline X}$, we may view it as a map into $\Prp { {\S X^t \times \Prp {\S X^{N-t}}} }$, where the last space carries the metric
\begin{align*}
  \rho_{\Prp { {\S X^t \times \Prp {\S X^{N-t}}} }}(\mu,\nu) & := \inf_{\gamma \in \Cpl \mu \nu} \pa<\Big>{ {\textstyle \int} \rho((x_i)_{i\leq t}, (y_i)_{i \leq t})^p \\
  & \phantom{:=}\quad + \mathcal W_p (\hat \mu, \hat \nu)^p \, \d\gamma((x_i)_{i\leq t},\hat \mu, (y_i)_{i\leq t}, \hat \nu) }^{1/p} \text{ .}
\end{align*}
We will call the resulting variant of Hellwigs information topology on $\Prp {\overline X}$ the \emph{$\mathcal W_p$-information topology}.

Similarly, one may systematically replace every occurrence of the weak topology in the definition of the extended weak topology by the $p$-Wasserstein metric. We call the resulting topology on $\Prp {\overline X}$ the \emph{extended $\mathcal W_p$-topology}.

Just like the weak topology is the coarsest topology which makes integration of continuous bounded functions continuous, the $p$-Wasserstein topology is the coarsest topology which makes integration of continuous functions bounded by $c \cdot (1 + \rho(x_0,x)^p)$ continuous.
Following this analogy, we define $AC_p({\overline X})$ as the set of all processes $(L_t)_{t=1}^N$ which are adapted, bounded by $x \mapsto c \cdot (1 + \rho(x_0,x)^p)$ for some $c \in \mathbb{R}_+$ and satisfy that $x\mapsto L_t(x) $ is continuous for each $t\leq N$.

  The \emph{$\mathcal W_p$-optimal stopping topology} on $\Prp {\overline X}$ is the coarsest topology which makes the functions
  \begin{align*}
    \mu \mapsto v^L(\mu)
  \end{align*}
  continuous for all $(L_t)_{t=1}^N \in AC_p({\overline X})$.

With these we may state the following generalization of Theorem \ref{thm:main_simple}:

\begin{theorem}
  \label{thm:main}
  Let $(\S X,\rho_\S X)$ be a Polish metric space and set ${\overline X} := \S X^N$. Then the following topologies on $\Prp {\overline X}$ are equal
  \begin{enumerate}
    \item the topology induced by $\mathcal A \mathcal W_p$
    \item the topology induced by $\mathcal S \mathcal C \mathcal W_p$
    \item the $\mathcal W_p$-information topology
    \item the extended $\mathcal W_p$-topology
    \item the $\mathcal W_p$-optimal stopping topology.
  \end{enumerate}
\end{theorem}

Clearly, one recovers Theorem \ref{thm:main_simple} from Theorem \ref{thm:main} by choosing a bounded metric on $\S X$, because the $\mathcal W_p$-information topology for bounded $\rho_\S X$ is just the information topology, the extended $\mathcal W_p$-topology for bounded $\rho_\S X$ is just the extended weak topology and the $\mathcal W_p$-optimal stopping topology for bounded $\rho_\S X$ is just the optimal stopping topology.

The relationship between the topologies listed in Theorem \ref{thm:main_simple} and those listed in Theorem \ref{thm:main} is similar to the non-adapted case where we know that usual $p$-Wasserstein convergence is equivalent to usual weak convergence plus convergence of the $p$-th moments.

\begin{restatable}{lemma}{convergencemoments}
\label{lem:convergence.moments}
  Convergence in any of the topologies of Theorem \ref{thm:main} is equivalent to convergence in any of the topologies of Theorem \ref{thm:main_simple} (where for building $\mathcal S \mathcal C \mathcal W_p$ and $\mathcal A \mathcal W_p$, $\rho_\S X$ is replaced by a bounded compatible complete metric e.g.\ $\min(1,\rho_\S X)$) plus convergence of $p$-th moments on ${\overline X}$ w.r.t.\ (the original) $\rho_{\overline X}$.
\end{restatable}
We prove Lemma \ref{lem:convergence.moments} in Section \ref{sec:convergence.moments}, making use of (parts of) Theorem \ref{thm:main_simple} and Theorem \ref{thm:main}.

\subsection{Further  remarks on related work}
\subsubsection{Some further articles of successors of Aldous}
 One of the original applications of Aldous' weak extended topology concerned the stability of optimal stopping \cite{Al81}. This corresponds to one half of \ref{it:Aldous}=\ref{it:optstop} in Theorem \ref{thm:main_simple}, but in a much more general setting. This line of work has been continued by Lamberton and Pag\`es \cite{LaPa90}, Coquet and Toldo \cite{CoTo07}, among others.

Aldous' extended weak topology was also inspiring and instrumental for the development of the theory of convergence of filtrations, and the associated questions of stability of the martingale representation property and Doob-Meyer decompositions. In this regard, see the works by Hoover et al \cite{HoKe84,Ho91} and by M\'emin et al \cite{CoMeSl01,Me03}. The related question of stability of stochastic differential equations (as well as their backwards version) with respect to the \textit{driving noise} has particularly seen a burst of activity in the last two decades. For brevity's sake we only refer to the recent article by Papapantoleon, Posama\"i, and Saplaouras \cite{PaPoSa18} for an overview of the many available works in this direction.

\subsubsection{Previous applications of adapted Wasserstein distances.}

Pflug, Pichler and co-authors \cite{PfPi12, Pi13,  PfPi14, PfPi15, PfPi16, GlPfPi17} have extensively developed and applied the notion of nested distaces for the purpose of scenario generation, stability, sensitivity bounds, and distributionally robust stochastic optimization, in the context of operations research.

Acciaio, Zalashko, and one of the present authors consider in \cite{AcBaZa16} the adapted Wasserstein distance in continuous time in connection with utility maximization, enlargement of filtrations and optimal stopping.

Causal couplings have appeared in the work by Yamada and Watanabe \cite{YW}, Jacod and M\'emin \cite{JaMe81} as well as Kurtz \cite{Ku07,Ku14}, concerning weak solutions of stochastic differential equations, and by R\"uschendof \cite{Ru85} concerning approximation theorems in probability theory. The term `causal' is first used by Lassalle \cite{Las18}, who uses it in an additional constraint for the transport problem and gives an alternative derivation of the Talagrand inequality for the Wiener measure.
 Causal couplings are also present in the numerical scheme suggested in \cite{AcBaCa18} for (extended mean-field) stochastic control.

The article \cite{BaBeHuKa17} connects  adapted Wasserstein distance (in continuous time) to martingale optimal transport  (cf.\ \cite{HoNe12,  BeHePe12, GaHeTo13, DoSo12, BoNu13, HoKl13, CaLaMa14, BeCoHu14, BeNuTo16} among many others). Several familiar objects appear as solutions to variational problems in this context. E.g.\ geometric Brownian motion is the martingale which is closest in $\mathcal {AW}_2$ to usual Brownian motion subject having a log normal distribution at the terminal time-point, the local vol model is closest to Brownian motion subject to matching 1-d marginals.

Bion-Nadal and Talay \cite{BiTa19} introduce an adapted Wasserstein-type distance on the set of diffusion SDEs and show that this distance corresponds to the computation of a tractable stochastic control problem. They also apply their results to the problem of fitting diffusion models to given marginals.

In \cite{BaBaBeEd19a} the present authors consider adapted Wasserstein distances in relation to stability in finance:
Lipschitz continuity of utility maximization/hedging are established w.r.t.\ to the underlying models in discrete and continuous time.

\subsection{Another formulation of the adapted Wasserstein distance and of Hellwigs information topology}
\label{sec:DerErhabeneRaum}

Here we give an alternative formulation of the adapted Wasserstein distance / nested distance due to  Pflug and Pichler.

Again, $\S X$ is a Polish space and $\rho = \rho_\S X$ is a compatible metric on $\S X$. Starting with $V_N^p:=0$ we define
\begin{align}\label{valuefunctiongeneral}
	&V_t^p(x_1,\dots,x_{t},y_1,\dots,y_{t}):= \\
	&\inf_{\gamma^{t+1} \in \Couplings(\mu_{x_1,\dots,x_{t}}, \nu_{y_1,\dots,y_{t}} )} \iint \! \left( \! \begin{array}{cc}V^p_{t+1}(x_1,\dots,x_{t+1},y_1,\dots,y_{t+1})\\+\ \rho(x_{t+1},y_{t+1})^p\end{array} \! \right) \! \d\gamma^{t+1}(x_{t+1}, y_{t+1}).\nonumber
\end{align}
 The nested distance is finally obtained in a backwards recursive way by
\begin{equation}\label{eq:Nested}
  \mathcal{ND}_p(\mu,\nu)^p =\inf_{ \gamma^1 \in \Couplings(\push {{\proj_1}} (\mu),\push {{\proj_1}} (\nu)) }
	\iint	\left( 	V^p_1(x_1,y_1)+\ \rho(x_1,y_1)^p
		\right)\d\gamma^1(x_1,y_1).
\end{equation}
Then $\mathcal A \mathcal W_p = \mathcal{ND}_p$. We refer to \cite{BaBeLiZa16} for the (straightforward) justification.

For $N>1$ the adapted Wasserstein distance is not complete. As was established in \cite{BaBeEdPi17}, a natural complete space into which $(\Prp{{\overline X}},\mathcal {AW}_p)$ embeds is given by the space of \emph{nested distributions}:

Consider the sequence of metric spaces
\begin{align*}
	\XP{N}   &:= (\mathcal{X}, \DP{N}),
  & \DP{N}   & :=\rho=(\rho^p)^{1/p},\\
	\XP{N-1} &:= \big(\mathcal{X}\times \Prp{\XP{N}},  \DP{N-1}\big),
  & \DP{N-1} & :=\left (\rho^p + \mathcal W_{\DP{N},p}^p\right)^{1/p},\\
  & \vdots & \vdots \nonumber\\
	\XP{1}   &:= \big(\S X \times \Prp{\XP{2}}, \DP{1}\big),
  & \DP{1}    & :=\left(\rho^p + \mathcal W_{\DP{2},p}^p\right)^{1/p},
\end{align*}
where at each stage $t$, the space $\Prp{\XP{t}}$ is endowed with the $p$-Wasserstein distance with respect to the metric $\DP{t}$ on $\XP{t}$, which we denote  by $\mathcal W_{ \DP{t},p}$.
		The space of \emph{nested distributions} (of depth $N$) is defined as $\Prp{\XP{1}}$.
We endow $\Prp{\XP{1}}$ with the complete metric $\mathcal W_{\DP{1},p}$.

The space of nested distributions was defined by Pflug \cite{Pf09}. Notably the idea to iterate the formation of Wasserstein spaces and metrics  goes back to Vershik \cite{Ve70, Ve94} who uses the name `iterated Kantorovich distance'. The main interest of Vershik (and his successors)  lies in the classification of filtrations (in the language of ergodic theory). We refer to the work of Emery and Schachermayer \cite{EmSc01} for a survey from a probabilistic perspective and to Janvresse, Laurent and de la Rue \cite{JaLaDe16} for a contemporary article (again from a probabilistic viewpoint).

$\Prp{{\overline X}}$ is naturally embedded in the set of nested distributions of depth $N$ through the map $\mathcal N$ given by
\begin{align}
  \label{eq:Nmapintro}
  &  \mathcal N (\mu) := \CLaw{X_1, \CLaw{X_2, \cdots \CLaw{X_{N-1}, \CLaw{X_N}[\Xv 1 {N-1}] }[\Xv 1 {N-2}] \cdots }[X_1]}
\end{align}
where $(X_1,\dots,X_N)$ is a vector with law $\mu$, $\mathscr L$ again denotes (conditional) law and we use $\Xv 1 t$ as a shorthand for the vector $X_1, \dots, X_t$.

Following \cite{BaBeEdPi17}, we have:
\begin{theorem}
  \label{thm:Nembedding}
  The map $\mathcal N$ defined in \eqref{eq:Nmapintro} embeds the metric space $(\Prp {\overline X},\mathcal {AW}_p)$ \emph{isometrically} into the complete separable metric space $(\Prp{\XP 1}, \mathcal W_{\DP{1},p})$.
\end{theorem}

\begin{remark}
  When $\S X$ has no isolated points, $\Prp{\XP 1}$ is actually the completion of $\Prp {\overline X}$, i.e. $\Prp {\overline X}$ considered as a subset of $\Prp{\XP 1}$ is dense.
\end{remark}

\subsubsection{Hellwig's information topology in terms of adapted Wasserstein distances}
\label{sec:HellwigAdap}
We note that   Hellwig's definition of the information topology can also be rephrased  using the concept of adapted Wasserstein distance:
Assume that $\rho_\S X$ is a bounded metric and for $t \leq N$, set
$${\overline X} = {\mathcal X}^N=\underbrace{{\mathcal X}^t}_{=:X_1^{(t)}}\times \underbrace{{\mathcal X}^{N-t}}_{=:X_2^{(t)}}=X_1^{(t)} \times X_2^{(t)}.$$ I.e.\  for each $t$, we consider ${\overline X}$ as the product of two Polish spaces (which one might consider as `history' and `future'). Extending the defintion of $\mathcal A \mathcal W_p$ in the obvious way to products of not necessarily equal Polish spaces, we can then equip $\Prp {X_1^{(t)} \times X_2^{(t)}}$ with a \emph{one period} adapted Wasserstein distance $\mathcal {AW}_{p}^{(t)}, p\geq 1$.
Setting  for $\mu, \nu\in \mathcal P({\overline X})$
\begin{align}
\mathcal{IW}_p(\mu, \nu):= \sum_{t=1}^N \mathcal {AW}_{p}^{(t)}(\mu, \nu),\quad  p\geq 1,
\end{align}
we obtain a compatible metric for the information topology. This is relatively straightforward (whereas the full version of Theorem \ref{thm:main_simple} is not straightforward as far as we are concerned).

\subsection{Preservation of Compactness}
We close this section with a result about the preservation of relative compactness which we shall use in Sections \ref{sec:CausalAndAnti} and \ref{sec:convergence.moments}, but which also might be of independent interest. Specifically, in \cite{BaBePa18,BaPa19} the two-step version of Lemma \ref{lem:CompactnessLemma} is used as a crucial tool in the investigation of the weak transport problem.

A more detailed investigation of compactness in $\Pr {\overline X}$ with the weak adapted topology is the topic of the companion paper to this one, \cite{ModulusOfContinuity}.

Assume for simplicity that $\rho_\S X$ is a bounded metric. Then we have

\begin{lemma}[Compactness lemma]\label{lem:CompactnessLemma}
  $ A \subseteq \Pr{\overline X}$ is relatively compact w.r.t.\ the usual weak topology iff $\mathcal N[A] \subseteq \Pr{\XP 1}$ is relatively compact.
\end{lemma}
We note that Lemma \ref{lem:CompactnessLemma} is essentially a consequence of the characterization of compact subsets in $\Pr{\Pr{X}}$; in a somewhat different framework it was first proved in \cite{Ho92}. The version stated here follows by repeated application of \cite[Lemma 3.3]{ModulusOfContinuity}/\cite[Lemma 2.6]{BaBePa18}.

The implication that $\mathcal N[A]$ relatively compact implies $A$ relatively compact is rather easy to see, but the other direction that $A$ relatively compact implies $\mathcal N[A]$ relatively compact is nontrivial since the mapping $\mathcal N: \Pr{\overline X} \to\Pr{\mathcal X_{1:N}}$ is not continuous when $\Pr{\overline X}$ is endowed with the usual weak topology (except for trivial cases).
Lemma \ref{lem:CompactnessLemma} would \emph{not} be true if we were to replace relative compactness by compactness.

The assumption that $\rho_\S X$ is bounded is inessential. A version of Lemma \ref{lem:CompactnessLemma} holds if we replace $\Pr {\overline X}$ by $\Prp {\overline X}$ and the weak topology by the one induced by the $p$-Wasserstein metric.

A similar result based on Hellwig's information toplogy, relating relative compactness in $\Pr {\overline X}$ to relative compactness in $\prod_{t=1}^{N-1} \Pr {\S X^t \times \Pr {\S X^{N-t}}}$, is also true.

\let\push\fancypush

\section{Preparations}

The rest of the paper will essentially be devoted to proving Theorem \ref{thm:main_simple}, or really its generalization Theorem \ref{thm:main}.

In Section \ref{sec:arrows} we prove that Hellwig's information topology equals the topology induced by $\mathcal A \mathcal W_p$, i.e.\ $\ref{it:Hellwig} = \ref{it:AW}$ in Theorem \ref{thm:main}.
In a sense, of all the topologies listed in Theorem \ref{thm:main}, Hellwig's information toplogy \enquote*{looks} the coarsest -- or at least like one of the coarser ones, while the topology induced by $\mathcal A \mathcal W_p$ \enquote*{looks} the finest.

In Section \ref{sec:CausalAndAnti} we sandwich the topology induced by $\mathcal S \mathcal C \mathcal W_p$ between Hellwig's information topology and the toplogy induced by $\mathcal A \mathcal W_p$, i.e.\ we show $\ref{it:Hellwig} \leq \ref{it:SCW} \leq \ref{it:AW}$ in Theorem \ref{thm:main}.

In Section \ref{sec:Aldous} we show that Aldous' extended weak topology is equal to Hellwig's information topology, i.e. $\ref{it:Aldous} = \ref{it:Hellwig}$ in Theorem \ref{thm:main}.

In Section \ref{sec:convergence.moments} we prove Lemma \ref{lem:convergence.moments}.

In Section \ref{sec:OptStop} we prove that the optimal stopping topology is coarser than the topology induced by $\mathcal A \mathcal W_p$ and finer than Hellwig's ($\mathcal W_p$-)information topology, i.e. $\ref{it:Hellwig} \leq \ref{it:optstop} \leq \ref{it:AW}$ in Theorem \ref{thm:main}.

\subsection{Notation}

The nested structure of spaces like for example $\Prp {\XP{1}}$ introduced in Section \ref{sec:DerErhabeneRaum} is (at least for the authors) not so easy to gain an intuition for. It seems rather challenging to picture probability measures on probability measures on probability measures\dots{} etc.

Therefore, much of the proofs in the following two sections will be about bookkeeping and not getting lost in these nested structures.
In most other contexts we would regard such bookkeeping as abstract nonsense better swept under the rug, but in the context of the present paper we believe that it really constitutes an important and nontrivial ingredient in successfully carrying out the proofs.

To aid in this endeavour we make some notational preparations and introduce a few conventions.

\subsubsection{Operations on Spaces}
In the introduction we described the topologies listed in Theorems \ref{thm:main_simple} and \ref{thm:main} as initial topologies w.r.t.\ maps into more complex spaces. These spaces are built up from just a few basic operations, and in most cases the maps can also be constructed using a few relatively simple ingredients.

For spaces, the operations in question are
\begin{itemize}
  \item product formation, i.e.\ for spaces $\S X$ and $\S Y$ we may form their product space $\S X \times \S Y$,
  \item and passing from a space $\S X$ to the space $\Pr \S X$ of probability measures on $\S X$.
\end{itemize}

Here we run into some tension between the various existing definitions in the literature. While Hellwig and Aldous originally defined their topologies based on equipping the space $\Pr \S X$ of probability measures on some space $\S X$ with the weak topology, without any mention of metrics, $\mathcal A \mathcal W_p$ is a metric built on the $p$-Wasserstein metric, and Theorem \ref{thm:Nembedding} exhibits this metric as the \enquote*{initial metric} w.r.t.\ an embedding of $\Prp {\overline X}$ (not $\Pr {\overline X}$) into $(\Prp{\XP 1}, \mathcal W_{\DP{1},p})$.

Luckily, when the base metric $\rho_\S X$ on $\S X$ is bounded and we decide that we only care about topologies and not the metrics that induce them, all of these distinctions vanish, and one may hope for these fine distinctions to not be so important in the end.

To give as uniform and as streamlined a treatment as possible of all the various ways in which these metric and topological spaces can be related to each other we employ the following strategy:
A lot of our arguments are agnostic to the distinction between $\mathscr P$ and $\mathscr P_p$, and to whether we are talking about metric or topological spaces etc. They only rely on properties of the operations of product formation and formation of spaces of probability measures and on properties of maps between various spaces built using these operations which hold in either case.
For the rest of the paper we will therefore drop the $p$ in $\mathscr P_p$ and other explicit mentions of these distinctions. The reader may decide to read the paper using either of the following two sets of conventions, which are to be applied recursively:

\noindent{\bf Convention 1 (weak topologies)}
\begin{itemize}
  \item $\S X$, $\S Y$, $\S Z$, $\S A$, $\S B$, $\S C$, etc. are Polish spaces.
  \item $\S X \times \S Y$ is a topological space with the product topology (again Polish).
  \item $\Pr \S X$ is a topological space with the weak topology (also Polish).
  \item \enquote*{space} will mean Polish space.
\end{itemize}

\noindent{\bf Convention 2 ($\mathcal W_p$)}
\begin{itemize}
  \item $p \geq 1$ is fixed throughout the paper
  \item $\S X$, $\S Y$, $\S Z$, $\S A$, $\S B$, $\S C$, etc. are Polish (i.e.\ complete separable) metric spaces with metrics $\rho_\S X$, $\rho_\S Y$, $\rho_\S Z$, $\rho_\S A$, $\rho_\S B$, $\rho_\S C$, etc.\ respectively.
  \item $\S X \times \S Y$ is a Polish metric space with the metric
    \begin{align*}
      \rho_{\S X \times \S Y}((x_1,y_1),(x_2,y_2)) := \pa{\rho_\S X(x_1,x_2)^p + \rho_\S Y(y_1,y_2)^p}^{1/p} \text{ .}
    \end{align*}
  \item $\Pr \S X$ is a Polish metric space with the $p$-Wasserstein metric
    \begin{align*}
      \rho_{\Pr \S X}(\mu,\nu) := \inf_{\gamma \in \Cpl \mu \nu} \pa{ {\textstyle \int} \rho(x_1,x_2)^p \d\gamma(x_1,x_2) }^{1/p} \text{ .}
    \end{align*}
  \item The subscript on the metric $\rho$ may be dropped when clear from the context.
  \item \enquote*{space} will mean Polish metric space.
\end{itemize}

Unless specified otherwise everything said from here on will be true for either way of reading.
Convention 1 will lead to a direct proof of Theorem \ref{thm:main_simple}, while Convention 2 will give a proof of the more general version, Theorem \ref{thm:main}.
Occasionally an argument will require us to talk directly about metrics to establish continuity of some map. When one only cares about Theorem \ref{thm:main_simple} and not Theorem \ref{thm:main} these sections can be read while assuming that $p=1$ and that all metrics mentioned are bounded.

Another space we will need is
\begin{definition}
  $ \FunP \S A \S B \subseteq \mathscr P(\S A \times \S B) $ is the space of probability measures on $\S A \times \S B$ which are concentrated on the graph of a measuruable function, i.e.:
  \begin{multline*}
    \FunP \S A \S B := \set<\Big>{ \mu \in \mathscr P(\S A \times \S B) }[ \exists f : \S A \rightarrow \S B \text{ measurable s.t. } \mu(\mathrm{graph}(f)) = 1 ] \text{ .}
  \end{multline*}
  The space $\FunP \S A \S B$ carries the subspace topology / the restriction of the metric on $\Pr {\S A \times \S B}$.
\end{definition}

\subsubsection{Maps between spaces}
Assuming Convention 1, when $f: \S X \to \S Y$ is a continuous map, the pushforward under $f$, i.e.\ the map which sends $\mu \in \Pr \S X$ to the measure $\nu \in \Pr \S Y$ with $\nu(A) = \mu(f^{-1}[A])$ is also continuous.

Similarly, assuming Convention 2, when $f: \S X \to \S Y$ is a Lipschitz-continuous map between metric spaces the pushforward under $f$ is also Lipschitz-continous from $\Pr \S X$ to $\Pr \S Y$.

We will use $\push f: \Pr \S X \to \Pr \S Y$ to denote the pushforward under $f$, to emphasize the fact that $\mathscr P$ is a \emph{functor}, i.e.\ that it sends a diagram with a \enquote*{nice} (read continuous/Lipschitz) map
\begin{align*}
  \S X \overset{f}\longrightarrow \S Y
\end{align*}
to a similar diagram
\begin{align*}
  \Pr \S X \overset{\push f}\longrightarrow \Pr \S Y
\end{align*}
where the map is also \enquote*{nice}, and that $\push {f \circ g} = \push f \circ \push g$ and $\push {\id\S X} = \id{\Pr \S X}$ (where $\id\S X$ is the identity function on $\S X$).

For a product of spaces $\S X \times \S Y$, the projection onto $\S X$ will alternatively be denoted by either $\proj_\S X$ or by the same letter that is used for the space, but in a non-calligrapic font, i.e. $X : \S X \times \S Y \to \S X$.

If $\mu$ is defined on some product $\prod_i \S X_i$ of spaces, we also introduce a shorthand notation for marginals of $\mu$, i.e.\ for the pushforward of $\mu$ under projection onto the product of some subset of the original factors:
\begin{align*}
  \marg \mu {(\S X_{i_j})_j} = \push {(\RV X_{i_j})_j} (\mu) \text{ .}
\end{align*}

If $f: \S A \rightarrow \S B$ and $g: \S A \rightarrow \S C$ are functions we write $(f \bm, g)$ for the function
\begin{align*}
  (f \bm, g) & : \S A \rightarrow \S B \times \S C \\
  (f \bm, g) (a) & := (f(a),g(a)) \text{ .}
\end{align*}

If we want to specify a map from, say $\S A \times \S B \times \S C$ to $\S X$ but we only really care about one of the variables we will use an underscore \enquote*{$\_$} instead of naming the unused variables, as in $(a,\_,\_) \mapsto f(a)$. Similarly, when integrating we may also use $\_$ to denote unused variables, i.e. for $\mu \in \Pr {\S X \times \S Y}$ we might write ${\textstyle \int} f(y) \d\mu(\_,y)$.

Two important maps will be the disintegration map $\disint \S A \S B$ and its left inverse $\und \S A \S B$.

The disintegration map
  $$ \disint \S A \S B : \mathscr P(\S A \times \S B) \rightarrow \FunP \S A {\mathscr P(\S B)} $$
sends a probability $\mu$ on $\S A \times \S B$ to the measure
  $$ \push<\big>{(a,\_) \mapsto (a,\mu_a)}(\mu) $$
where $a \mapsto \mu_a$ is a classical disintegration of $\mu$, i.e. if $\bar \mu = \disint \S A \S B (\mu)$ then
  $$ \int f(a,b) \d\nu(b) \d\bar\mu(a,\nu) = \int f(a, b) \d\mu_a(b) \d\mu(a,\_) = \int f(a,b) \d\mu(a,b) \text{ .}$$
The disintegration map is measurable (see for example \cite[Proposition 7.27]{BeSh78}) and injective. It is not continuous w.r.t.\ the weak topologies or the Wasserstein metrics.

When writing $\disint {\S A} {\S B}$ we will not insist that $\S A$ has to be the first factor in the domain of $\disint {\S A} {\S B}$ -- $\S A$ and $\S B$ may even be products themselves, whose factors are intermingled in the product that makes up the domain of $\disint {\S A} {\S B}$. Also, we may sometimes omit $\S B$, only specifying the variable(s) w.r.t.\ which we are disintegrating, not the ones which are left over, as in $\diso {\S A}$.

The map
\begin{align*}
  \und \S A \S B & : \Pr { \S A \times \Pr \S B } \rightarrow \Pr { \S A \times \S B } \\
  \und \S A \S B & (\mu) := f \mapsto \int f(a,b) \d\nu(b) \d\mu(a,\nu)
\end{align*}
is (Lipschitz-)continuous.

The pair $\disint \S A \S B$, $\und \S A \S B$ enjoy the following properties:
\begin{enumerate}
  \item $\und \S A \S B$ is the left inverse of the disintegration map, i.e.\
    $$ \und \S A \S B \circ \disint \S A \S B = \id {\Pr { \S A \times \S B }} \text{ .} $$
    This is a direct consequence of the definition of the disintegration.
  \item $\restr{\und \S A \S B}{\FunP \S A {\Pr \S B}}$ is injective. Therefore,
  \item $\disint \S A \S B \circ \restr{\und \S A \S B}{\FunP \S A {\Pr \S B}} = \id { \FunP \S A {\Pr \S B} }$, i.e.\ $\disint \S A \S B$ and $\und \S A \S B$ are inverse bijections between $\Pr { \S A \times \S B}$ and $ \FunP \S A {\Pr \S B} $.
\end{enumerate}
The last two properties are just a reformulation of the known fact that the disintegration of a measure is almost-surely uniquely defined.

\subsubsection{Processes which take values in different spaces at different times}

Already in the introduction, in Section \ref{sec:HellwigAdap}, we found it convenient to extend the definition of $\mathcal A \mathcal W_p$ to products of not necessarily equal Polish spaces \enquote*{in the obvious way}. To accommodate for reapplication of concepts in a similar style as seen there we make the minor generalization of letting all the processes we talk about take values in different spaces at different times -- typically at time $t$ they will take values in a space $\S X_t$.

Denote by $\overline X_j^k := \prod_{i=j}^k \S X_i $ and define $\overline X := \overline X_1^N$, $\overline X^k := \overline X_1^k$, $\overline X_j := \overline X_j^N$.

\section{Hellwig's \texorpdfstring{$\mathcal W_p$-}{Wp-}information topology is equal to the topology induced by \texorpdfstring{$\mathcal A \mathcal W_p$}{the adapted Wasserstein distance}}
\label{sec:arrows}

In this section we show $\ref{it:Hellwig} = \ref{it:AW}$ in Theorem \ref{thm:main}. We will do so by identifying both topologies as initial topologies w.r.t.\ a single map each, i.e.\ finding a space which is homeomorphic to $\Pr \overline X$ with Hellwig's ($\mathcal W_p$-)information topology and one which is homeomorphic to $\Pr \overline X$ with the topology induced by $\mathcal A \mathcal W_p$ and then showing that these spaces are homeomorphic in the right way. As an auxilliary tool we will introduce another topology on $\Pr \overline X$ which wasn't mentioned in the introduction, but which is very similar to Hellwig's.
The proof strategy can be summarized by saying that we want to show that the following diagram is commutative.
\begin{align}
  \label{diag:contmaps}
\begin{tikzpicture}[x=3cm,y=2cm,baseline={([yshift=-.5ex]current bounding box.center)}]
  \node (PX)   at  (0,1) {$ \Pr {\overline X} $};
  \node (FFF)  at  (1,0) {$ \FFF $};
  \node (I)    at  (0,0) {$ \mathcal I\br[]{\Pr {\overline X}} $};
  \node (Ip)   at (-1,0) {$ \mathcal I'\br[]{\Pr {\overline X}} $};
  \draw[->] (PX)  edge node[auto] {$ \mathcal N $} (FFF);
  \draw[->] (PX)  edge node[auto] {$ \mathcal I $} (I);
  \draw[->] (PX)  edge node[left] {$ \mathcal I' $} (Ip);
  \draw[->,out=300,in=240] (Ip) edge node[below] {$ \H $} (FFF);
  \draw[->] (FFF) edge node[auto] {$ \mathcal K $} (I);
  \draw[->] (I)   edge node[auto] {$ \L $} (Ip);
\end{tikzpicture}
\end{align}
Here $\mathcal N$ is the map which induces the same topology as $\mathcal A \mathcal W_p$, $\mathcal I$ induces Hellwig's topology and $\mathcal I'$ induces what we will call the \emph{reduced} information topology. We shortly restate their definitions below.

{\color{black}
Since these mappings are injective and by the definition of the initial topology all of these mappings are homeomorphisms. To be precise, $\mathcal N$ is a homeomorphism from ${\Pr {\overline X}}$ with the topology induced by $\mathcal A \mathcal W_p$ onto $\mathcal N[{\Pr {\overline X}}]$ {(cf.\ Theorem \ref{thm:Nembedding})},  $\mathcal I$ is a homeomorphism from ${\Pr {\overline X}}$ with the information topology onto $\mathcal I[{\Pr {\overline X}}]$, and
$\mathcal I'$ is a homeomorphism from ${\Pr {\overline X}}$ with the reduced information topology  onto $\mathcal I'[{\Pr {\overline X}}]$.
}

 The maps $\mathcal K$, $\L$, $\H$ are still to be found.

As introduced in Section \ref{sec:HellwigIntro} Hellwig's ($\mathcal W_p$-)information topology is induced by a family of maps $\mathcal I_t$, given by:
\begin{align*}
  \mathcal I_t & : \Pr {\overline X} \rightarrow \FunP {\overline X^t} {\Pr{ \overline X_{t+1} }} \\
  \mathcal I_t & := \disint {\overline X^t} {\overline X_{t+1}} \text{ .}
\end{align*}
Equivalently, the information topology is the initial topology w.r.t.\ the map
\begin{align*}
  \mathcal I & : \Pr {\overline X} \rightarrow \prod_{t=1}^{N-1} \FunP {\overline X^t} {\Pr{ \overline X_{t+1} }} \\
  \mathcal I(\mu) & := (\mathcal I_t(\mu))_t \text{ .}
\end{align*}
We saw in Section \ref{sec:DerErhabeneRaum} that $\mathcal A \mathcal W_p$ is induced by an embedding $\mathcal N: \Pr \overline X \to \Pr {\XP 1}$. Rephrasing the definition there, $\mathcal N$ is obtained by defining recursively from $t=N-1$ to $t=1$:
\begin{align*}
  \mathcal N^{N}   & := \id{\Pr \overline X} \\
  \mathcal N^{t}   & := \disint {\overline X^t} {\XP{t+1}} \circ \mathcal N^{t+1}
  \intertext{and setting}
  \mathcal N & := \mathcal N^1 \text{ .}
\end{align*}
In fact, because $\dis$ maps into the space of measures concentrated on the graph of a function, $\mathcal N$ also maps into a smaller space, which we call $\FFF[1]$, and which is again defined by recursion down from $N-1$ to $1$:
\begin{align*}
  \FFF[N] & := \Pr {\S X_N} \\
  \FFF[t] & := \FunP {\S X_{t}} {\FFF[t+1]} \text{ .}
\end{align*}
I.e.\ $\FFF$ is $\Pr {\XP 1}$ with all occurences of $\Pr {\cdot \times \cdot}$ replaced by $\FunP \cdot \cdot$.
Remember that we had
\begin{align*}
  \XP N & := \S X_N \\
  \XP t & := \S X_t \times \Pr {\XP {t+1}} \text{ .}
\end{align*}
For convenience, let us also define
\begin{align*}
  \PPP[t] & := \Pr {\XP t} \text{ .}
\end{align*}
\gobble{
For symmetry we also define
\begin{align*}
  \PPP[t] & := \Pr {\XP t}
  \intertext{and}
  \XF N & := \S X_N \\
  \XF t & := \S X_t \times \Pr {\XF {t+1}} \text{ .}
\end{align*}
}

The fact that
\begin{align*}
  \mathcal N^t : \Pr \overline X \to \FunP {\overline X^t} {\FFF[t+1]}
\end{align*}
and that therefore $\mathcal N$ maps into $\FFF$ is a consequence of Lemma \ref{lem:functionsremainfunctions} below.

Finally, $\mathcal I'$ is defined as follows
\begin{align*}
  \mathcal I' & : \Pr {\overline X} \rightarrow \prod_{t=1}^{N-1} \FunP {\overline X^t} {\Pr{ \S X_{t+1} }} \\
  \mathcal I'(\mu) & := (\mathcal I'_t(\mu))_t \\
  \mathcal I'_t & : \Pr {\overline X} \rightarrow \FunP {\overline X^t} {\Pr{ \S X_{t+1} }} \\
  \mathcal I'_t & := \disint {\overline X^t} {\S X_{t+1}} \circ \push{\proj_{\overline X^{t+1}}} \text{ .}
\end{align*}
I.e. the reduced information topology, like the information topology, makes continuous predictions about the behaviour of the process after time $t$ given information about its behaviour up to time $t$, only now we are just predicting what the process will do in the next step, not for the rest of time.

$\mathcal I$, $\mathcal I'$ and $\mathcal N$ are injective and therefore bijections onto their codomains. This means that the values of the maps $\mathcal K$, $\L$, $\H$ in diagram \eqref{diag:contmaps} as functions between sets are really already prescribed. The task consists in finding a representation for them which makes it clear that they are continuous.

\begin{lemma}
  \label{lem:functionsremainfunctions}
  $\disint \S A {\S B \times \S Y}$ restricted to $\FunP {\S A \times \S B} \S Y$ maps onto $\FunP<\!\big> \S A { \FunP \S B \S Y }$.
\end{lemma}
\begin{proof}
  We first show that it maps into $\FunP<\big> \S A { \FunP \S B \S Y }$.
  Let $\nu \in \FunP<\big> {\S A \times \S B} \S Y$ and let $g : \S A \times \S B \rightarrow \S Y$ be a function witnessing this fact, i.e.\ $\nu(f) = \int f(a,b,g(a,b)) \d \nu(a,b,\_)$.

  Let $\alpha := \disint \S A {\S B \times \S Y} (\nu)$. Then
  $$\int \int 1_{g(a,b) \neq y} \d \beta(b, y) \d\alpha(a, \beta) = \int 1_{g(a,b) \neq y} \d \nu(a,b,y) = 0 \text{ .}$$
  This means that for $\alpha$-a.a.\ $(a,\beta)$ we have $ \int 1_{g(a,b) \neq y} \d \beta(b, y) = 0 $, i.e.\ $\beta$ is concentrated on the graph of the function $b \mapsto g(a,b)$.

  To see that any $\alpha \in \FunP<\big> \S A { \FunP \S B \S Y }$ can be obtained as the image of some $\nu \in \FunP {\S A \times \S B} \S Y$ under $\disint \S A {\S B \times \S Y}$, note that for such $\alpha$, by the existence of measurably dependent (classical) disintegrations (see for example \cite[Proposition 7.27]{BeSh78}), $\nu := \und \S A {\S B \times \S Y} (\alpha) \in \FunP {\S A \times \S B} \S Y$, and $\disint \S A {\S B \times \S Y} (\nu) = \alpha$.
\end{proof}

\subsection{Homeomorphisms}
We give a plain language description of what follows in this section:

The continuity of $\L$ will be quite trivial, because we are just discarding information.

The components $\mathcal K_k : \FFF \rightarrow \FunP {\overline X^k} {\Pr {\overline X_{k+1}}}$ of the map $\mathcal K$ are obtained by \enquote*{folding} both the \enquote*{head} and the \enquote*{tail} of $\FFF$ using iterated application of the map $\undis$.
\begin{align*}
  \overbrace{ \mathscr F \Bigg( \S X_1 \rightsquigarrow \mathscr F \bigg ( \dots \rightsquigarrow \mathscr F \Big ( \S X_k }^{\text{head}} \rightsquigarrow \overbrace{\mathscr F \big ( \S X_{k+1} \rightsquigarrow \mathscr F ( \dots \rightsquigarrow \mathscr P ( \S X_N ) \dots ) \big ) \!\!\vphantom{\Bigg|}}^{\text{tail}} \,\, \Big ) \dots \bigg ) \Bigg )
\end{align*}
By continuity of $\undis$, it's easy to see that $\mathcal K_k$ is continuous.
To show that the map $\mathcal K$ with the components $\mathcal K_k$ is the map we are looking for, we basically show that
\begin{align}
\label{eq:temp1321}
\mathcal I^{-1} \circ \mathcal K_k = \mathcal N^{-1} \text{ .}
\end{align}
$\mathcal N^{-1}$ is again another way of \enquote*{folding} all of $\FFF$ using $\undis$ to arrive at $\Pr \overline X$. As $\mathcal I^{-1}$ is also $\undis$, showing \eqref{eq:temp1321} amounts to showing that these two different ways of \enquote*{folding} -- first the head and tail and then in a last step the junction between $k$ and $k+1$ on the one hand, and from front to back on the other hand -- do the same thing. This may be intuitively clear to the reader. The proof works by repeated application of Lemma \ref{lem:undass}, which represents one step of \enquote*{folding order doesn't matter}. Using Lemma \ref{lem:undass} the proof is completely analogous to the proof that for an operation $\star$ satisfying $ (a \star b) \star c = a \star ( b \star c )$, i.e.\ for an associative operation, one has
\begin{multline*}
  \pa<\big>{ \pa{ \dots \pa{ \pa{x_1 \star x_2} \star x_3} \star \dots } \star x_k} \star \pa<\big>{ \pa{ \dots \pa{ \pa{ x_{k+1} \star x_{k+2} } \star x_{k+3} } \star \dots } \star x_N } \\ = \pa<\big>{ \pa{ \dots \pa{ \pa{x_1 \star x_2} \star x_3} \star \dots } \star x_N} \text{ .}
\end{multline*}
As we know, for such an operation any way of parenthesizing the multiplication of $N$ elements gives the same result. An analogous statement holds for $\undis$, though we do not formally state or prove this.

Finally, in Lemma \ref{lem:Hcont}, using Lemma \ref{lem:indkernel} as the main ingredient we prove the \enquote*{hard direction}, i.e.\ that $\H$ is continuous. If the continuity of $\L$ and $\mathcal K$ as informally described here seem obvious to the reader they may wish to skip ahead to Lemma \ref{lem:indkernel} and Lemma \ref{lem:Hcont}.

\begin{remark}
The reader interested in working out the details and analogies between \enquote*{folding} using $\undis$ and associative binary operations might be interested in reading about \emph{monads} in the context of Category Theory first. (See for example Chapter VI in \cite{MacLane}.) In fact, $(\mathscr P, \boldsymbol\eta, \boldsymbol\mu)$ forms a monad, where
\begin{align*}
  \boldsymbol\eta_\S X : \S X \rightarrow \Pr \S X
\end{align*}
sends an element $x$ of $\S X$ to the dirac measure at $x$ and
\begin{align*}
  \boldsymbol\mu_\S X & : \Pr { \Pr \S X } \rightarrow \Pr \S X \\
  \boldsymbol\mu_\S X(\nu) & := f \mapsto \iint f(x) \d \nu'(x) \d\nu(\nu') \text{ .}
\end{align*}
This monad is studied in a little more detail in \cite{Giry}.
$\undis$ can be obtained from $\boldsymbol\mu$ and a \emph{tensorial strength} $t_{\S A,\S B} : \S A \times \Pr \S B \rightarrow \Pr { \S A \times \S B }$ in the sense described for example in \cite{Moggi}.
\end{remark}

To show that $\L$ is continuous we will need the following lemma.
\begin{lemma}
  \label{lem:disnat}
  $\disint \S A \S B$ is natural in $\S B$, i.e.\ for $f: \S B \rightarrow \S B'$ the following diagram commutes.
  \begin{align*}
    \begin{tikzpicture}[x=6cm,y=2cm]
      \node (PAB)   at (1,1) {$ \Pr { \S A \times \S B} $};
      \node (PAB')  at (0,1) {$ \Pr { \S A \times \S B'} $};
      \node (FAB)   at (1,0) {$ \FunP \S A {\Pr \S B} $};
      \node (FAB')  at (0,0) {$ \FunP \S A {\Pr {\S B'}} $};
      \draw[->] (PAB) edge node[right] {$ \disint \S A \S B $} (FAB);
      \draw[->] (PAB') edge node[left] {$ \disint \S A {\S B'} $} (FAB');
      \draw[->] (PAB) edge node[above] {$ \push{ \id \S A \times f } $} (PAB');
      \draw[->] (FAB) edge node[below] {$ \push{ \id \S A \times \push f } $} (FAB');
    \end{tikzpicture}
  \end{align*}
\end{lemma}
\begin{proof}
  This is just straigtforward calculation using the definitions.
\end{proof}

Applying Lemma \ref{lem:disnat} with $\S A = \overline X^k$, $\S B = \overline X_{k+1}$, $\S B' = \S X_{k+1}$ and $f = \proj_{\S X_{k+1}} : \overline X_{k+1} \rightarrow \S X_{k+1}$ we get that
\begin{align*}
  \mathcal I'_k = \disint {\overline X^k} {\S X_{k+1}} \circ \push{ \id {\overline X^k} \times \proj_{\S X_{k+1}} } = \push{ \id {\overline X^k} \times \push{ \proj_{\S X_{k+1}}} } \circ \disint {\overline X^k} {\overline X_{k+1}}
\end{align*}
Setting $\L_k := \push{ \id {\overline X^k} \times \push{ \proj_{\S X_{k+1}}} }$ we get $ \mathcal I'_k = \L_k \circ \mathcal I_k$ and then setting $\L((\mu_k)_k) := (\L_k(\mu_k))_k$ gives $\mathcal I' = \L \circ \mathcal I$.

There is an analogue of Lemma \ref{lem:disnat} which we list here for completeness.
\begin{lemma}
  \label{lem:FFFandP}
  $\und \S A \S B : \Pr { \S A \times \Pr \S B } \rightarrow \Pr { \S A \times \S B }$ is natural in $\S B$, i.e.\ for $f: \S B \rightarrow \S B'$ the following diagram commutes:
  \begin{align*}
    \begin{tikzpicture}[x=6cm,y=2cm]
    \node (PPB)  at (1,1) {$\Pr {\S A \times \Pr \S B}$};
    \node (PPBB) at (0,1) {$\Pr {\S A \times \Pr {\S B'}}$};
    \node (PB)   at (1,0) {$\Pr {\S A \times \S B}$};
    \node (PBB)  at (0,0) {$\Pr {\S A \times \S B'}$};
    \draw[->] (PPB) edge node[above] {$\Pr {\id \S A \times \push f}$} (PPBB);
    \draw[->] (PB) edge node[below] {$\Pr {\id \S A \times f}$} (PBB);
    \draw[->] (PPB) edge node[right] {$ \und \S A \S B $} (PB);
    \draw[->] (PPBB) edge node[left] {$ \und \S A {\S B'} $} (PBB);
    \end{tikzpicture}
  \end{align*}
  In particular, if $\S B \subseteq \S B'$ then $$\restr{\und \S A {\S B'}}{\Pr {\S A \times \Pr \S B}} = \und \S A \S B$$ if we regard $\Pr {\S A \times \Pr \S B}$ as a subset of $\Pr {\S A \times \Pr {\S B'}}$ by recursively using the recipe: \enquote*{if $\S B$ is a subset of $\S B'$, then we can view $\Pr \S B$ as the subset of those $\mu \in \Pr {\S B'}$ which are concentrated on $\S B$}.
\end{lemma}
\begin{proof}
  Again this is just calculation.
\end{proof}
We already implicity used the \enquote*{in particular}-part of Lemma \ref{lem:FFFandP} when we said that $\mathcal N$ can be regarded both as a map into $\Pr{\XP 1}$ and into $\FFF$ but the use there seemed too trivial to warrant much mention. There will be more such tacit uses.
\let\XF\XP

Now we show that $\mathcal K$ is continuous. We claim that it can be written as
\begin{align*}
  \mathcal K(\mu) = \pa{ \mathcal K_k(\mu) }_k
\end{align*}
where
\begin{multline*}
  \mathcal K_k = \push<\Big>{ \id{\overline X^k} \times \pa<\big>{ \und {\overline X_{k+1}^{N-1}} {\XF{N} }  \circ \dots \circ \und {\overline X_{k+1}^{k+2}} {\XF{k+3}} \circ \und {\S X_{k+1}} {\XF{k+2}} } }   \circ \\    \und {\overline X^{k-1}} {\XF{k}} \circ \dots \circ \und {\overline X^2} {\XF{3}} \circ \und {\overline X^1} {\XF{2}} \text{ ,}
\end{multline*}
or without the dots, letting $\funprod$ denote concatenation of functions, e.g.\ $\funprod_{i=3}^1 f_i = f_3 \circ f_2 \circ f_1$:
\begin{align*}
  \mathcal K_k = \push<\Big>{ \id{\overline X^k} \times \pa<\big>{ {\textstyle \funprod_{i=N-1}^{k+1}} \und { \overline X_{k+1}^i } {\XF{i+1} } } }   \circ {\textstyle \funprod_{i=k-1}^1}  \und {\overline X^i} {\XF{i+1}} \text{ .}
\end{align*}

To prove this we will repeatedly apply the following lemma.

\begin{lemma}[$\undis$ is \enquote*{associative}]
  \label{lem:undass}
  $\undis$ satisfies the following relation:
  $$ \und {\S A \times \S B} \S C \circ \und \S A {\S B \times \Pr \S C} = \und \S A {\S B \times \S C} \circ \push { \id \S A \times \und \S B \S C} $$
  These maps can be seen in the following commutative diagram.
  \begin{align*}
    \begin{tikzpicture}[x=6cm,y=2cm]
      \node (PAPBPC) at (1,1) {$\Pr{\S A \times \Pr{\S B \times \Pr \S C}}$};
      \node (PABPC)  at (0,1) {$\Pr{\S A \times \S B \times \Pr \S C}$};
      \node (PAPBC)  at (1,0) {$\Pr{\S A \times \Pr{\S B \times \S C}}$};
      \node (PABC)   at (0,0) {$\Pr{\S A \times \S B \times \S C}$};
      \draw[->] (PAPBPC) edge node[above] {$\und \S A {\S B \times \Pr \S C}$} (PABPC);
      \draw[->] (PABPC)  edge node[left]  {$\und {\S A \times \S B} \S C$} (PABC);
      \draw[->] (PAPBPC) edge node[right] {$\push{ \id \S A \times \und \S B \S C}$} (PAPBC);
      \draw[->] (PAPBC)  edge node[below] {$\und \S A {\S B \times \S C}$} (PABC);
    \end{tikzpicture}
  \end{align*}
\end{lemma}
\begin{proof}
  This is just expanding the definition. Both maps send a measure $\alpha \in \Pr { \S A \times \Pr { \S B \times \Pr \S C } }$ to the measure $\mu$ with
  \begin{align*}
    {\textstyle \int} f \d\mu = {\textstyle \int} f(a,b,c) \d\gamma(c) \d\beta(b, \gamma) \d\alpha(a,\beta) \text{ .}
  \end{align*}
\end{proof}

\newcommand{\mathcal T}{\mathcal T}
\begin{lemma}
  \label{lem:easydirection}
  The following relation holds.
  \begin{align}
    \label{eq:easydirection}
    \und {\overline X^k} {\overline X_{k+1}} \circ \mathcal K_k = {\textstyle \funprod_{i=N-1}^1} \und {\overline X^i} {\XF{i+1}}
  \end{align}
\end{lemma}
\begin{proof}
  Again, this is just repeated application of Lemma \ref{lem:undass}.
  Below we define $\mathcal T_l$ for $N \geq l \geq k$ and show that
  \begin{align}
    \label{eq:tempass}
    \und {\overline X^k} {\overline X_{k+1}} \circ \funprod_{i=N-1}^{k+1} \push{ \id{\overline X^k} \times \und {\overline X_{k+1}^i} {\XP{i+1} }} = \mathcal T_l
  \end{align}
  for all $N \geq l \geq k$ by showing $\mathcal T_l = \mathcal T_{l-1}$ for all $N \geq l > k$.
  The left hand side of \eqref{eq:tempass} is the left hand side of \eqref{eq:easydirection} with the common tail ${\textstyle \funprod_{i=k-1}^1}  \und {\overline X^i} {\XF{i+1}}$ of the left and right side in \eqref{eq:easydirection} dropped. $\mathcal T_k$ will be the right hand side of \eqref{eq:easydirection} with the common part dropped.
  \begin{align*}
    \mathcal T_l := \funprod_{i=N-1}^l \und {\overline X^i} {\XP{i+1}}  \quad  \circ \,
               \und {\overline X^k} {\overline X_{k+1}^l \times \PPP[l+1]}  \, \circ \quad
               \funprod_{i=l-1}^{k+1} \push{ \id{\overline X^k} \times \und {\overline X_{k+1}^i} {\XP{i+1}} }
  \end{align*}
  Here we regard $\funprod_r^s \dots$ with $r < s$ (an empty product in our context) as the identity function.
  For $l = N$ the first factor is an empty product and therefore clearly \eqref{eq:tempass} is true for $l = N$.
  To get from $\mathcal T_l$ to $\mathcal T_{l-1}$ we leave the first factor alone and apply Lemma \ref{lem:undass} with $\S A = \overline X^k $, $\S B = \overline X_{k+1}^{l-1}$ and $\S C = \XP{l}$.
  This transforms
  $$ \und {\overline X^k} {\overline X_{k+1}^l \times \PPP[l+1]} \circ \push{ \id{\overline X^k} \times \und {\overline X_{k+1}^{l-1}} {\XP{l}} } $$
  into
  $$ \und {\overline X^{l-1}} {\XP{l}} \circ   \und {\overline X^k} {\overline X_{k+1}^{l-1} \times \PPP[l]} $$
  and therefore $\mathcal T_l$ into $\mathcal T_{l-1}$.
\end{proof}

\begin{lemma}
  \label{lem:easyconclusion}
  The right hand triangle in \eqref{diag:contmaps} commutes, i.e.\
  \begin{align*}
    \mathcal K_k \circ \mathcal N = \mathcal I_k \text{ .}
  \end{align*}
\end{lemma}
\begin{proof}
  Prepending $\mathcal N$ to \eqref{eq:easydirection} gives
  $$ \restr{\und {\overline X^k} {\overline X_{k+1}}}{\FunP {\overline X^k} {\Pr {\overline X_{k+1}}}} \circ \mathcal K_k \circ \mathcal N = \id { \Pr \overline X } $$
  and appending $\mathcal I_k$ gives
  $$ \mathcal K_k \circ \mathcal N = \mathcal I_k \text{ .} $$
\end{proof}

Now we will show that $\H$ is continuous.
We will postpone the proof of Lemma~\ref{lem:indkernel} below, which is the crucial non-bookkeeping ingredient in the proof of Lemma~\ref{lem:Hcont} below, until the end of this section. The methods used in the proof of Lemma~\ref{lem:indkernel} differ significantly from the rest in this section and make use of the concept of the \emph{modulus of continuity} for measures, and results relating to it, introduced in the companion paper \cite{ModulusOfContinuity} to this one.

\begin{restatable}{lemma}{indkernel}
  \label{lem:indkernel}
  Let $$\dom {\J \S A \S B \S Y} \subseteq \FunP<\big> \S A {\mathscr P(\S B)} \times \FunP<\big> {\S A \times \S B} \S Y$$ be the set of all $(\mu', \mu)$ s.t.\
  \begin{align}
    \label{eq:mu'mu}
    \und \S A \S B (\mu') = \marg {\mu} {\S A \times \S B} \text{ .}
  \end{align}
  The function
  \begin{align*}
    \J \S A \S B \S Y & : \dom {\J \S A \S B \S Y} \rightarrow \FunP<\big> \S A { \FunP \S B \S Y } \\
    \J \S A \S B \S Y & (\mu',\mu) := \disint \S A {\S B \times \S Y} (\mu)
  \end{align*}
  is continuous.
\end{restatable}

Clearly, as a function between sets, $\J \S A \S B \S Y (\mu',\mu)$ only depends on $\mu$. But, as we know, $\disint \S A {\S B \times \S Y}$ is \emph{not} continuous. Only when we refine the topology on the source space, which we encode by regarding $\J \S A \S B \S Y$ as a map from the above subset of a product space, does it become continuous.

\begin{lemma}
  \label{lem:Hcont}
  $\H$ is continuous.
\end{lemma}
\begin{proof}
  We will inductively define
  \begin{align*}
    \H^k : \mathcal I'\br[]{\Pr\overline X} \rightarrow \Pr{ \overline X^k \times \PPP[k+1]}
  \end{align*}
  (again down from $N-1$ to $1$) so that they will be continuous by construction (and by virtue of Lemma \ref{lem:indkernel}). Also by construction, we will have $\H^k \circ \mathcal I' = \mathcal N^k$.
  $\H$ will be $\H^1$ so that $\H \circ \mathcal I' = \mathcal N$.

  Set $\H^{N-1} := \proj_{N-1}$, the projection from $\prod_{k=1}^{N-1} \FunP {\overline X^k} {\Pr{ \S X_{k+1} }}$ onto the last factor. $\H^{N-1} \circ \mathcal I' = \mathcal I'_{N-1} = \disint {\overline X^{N-1}} {\S X_N} = \mathcal N^{N-1}$ by definition.
  Given $\H^{k+1}$ define
  \begin{align*}
    \H^k(\mu) := \J {\overline X^k} {\S X_{k+1}} {\FFF[k+2]} \pa { \proj_k(\mu), \H^{k+1}(\mu) } \text{ ,}
  \end{align*}
  where $\proj_k$ is the projection from $\prod_{k=1}^{N-1} \FunP {\overline X^k} {\Pr{ \S X_{k+1} }}$ onto the $k$-th factor.

  For this to be well-defined we need to check that for $\mu \in \mathcal I'\br[]{\Pr\overline X}$ we have $$\und {\overline X^k} {\S X_{k+1}} (\proj_k(\mu)) = \push{\proj_{\overline X^{k+1}}}\pa{\H^{k+1}(\mu)} \text{ .}$$
  I.e.\ for $\nu \in \Pr{\overline X}$ we want
  \begin{align*}
    \und {\overline X^k} {\S X_{k+1}} (\proj_k(\mathcal I'(\nu))) = \push{\proj_{\overline X^{k+1}}}\pa{\H^{k+1}(\mathcal I'(\nu))}
  \end{align*}
  The composite of the maps on the left-hand side is equal to
  \begin{align*}
    \und {\overline X^k} {\S X_{k+1}} \circ \mathcal I'_k = \und {\overline X^k} {\S X_{k+1}} \circ \disint {\overline X^k} {\S X_{k+1}} \circ \push{\proj_{\overline X^{k+1}}} = \push{\proj_{\overline X^{k+1}}} \text{ .}
  \end{align*}
  On the right-hand side we get by induction hypothesis
  \begin{align}
    \label{eq:rhscalc}
    \push{\proj_{\overline X^{k+1}}} \circ \mathcal N^{k+1} \text{ .}
  \end{align}
  Using that $\push{\proj_\S A} \circ \disint \S A \S B = \push{\proj_\S A}$ we see for $l \geq k+1$
  \begin{multline*}
    \push{\proj_{\overline X^{k+1}}} \circ \push{\proj_{\overline X^{l}}} \circ \mathcal N^l = \\
    \push{\proj_{\overline X^{k+1}}} \circ \push{\proj_{\overline X^{l}}} \circ \disint {\overline X^l} {\XF{l+1}} \circ \mathcal N^{l+1} = \\
    \push{\proj_{\overline X^{k+1}}} \circ \push{\proj_{\overline X^{l}}} \circ \mathcal N^{l+1} = \\
    \push{\proj_{\overline X^{k+1}}} \circ \push{\proj_{\overline X^{l+1}}} \circ \mathcal N^{l+1} \text{ ,}
  \end{multline*}
  i.e.\ by induction \eqref{eq:rhscalc} is also equal to $ \push{\proj_{\overline X^{k+1}}} $.

  As a composite of continuous maps $\H^k$ is clearly continuous. (This is where we use Lemma \ref{lem:indkernel}.) As a map between sets $\H^k$ is just
  \begin{align*}
    \disint {\overline X^k} {\XF{k+1}} \circ \H^{k+1} = \disint {\overline X^k} {\XF{k+1}} \circ \mathcal N^{k+1} = \mathcal N^k
  \end{align*}
  by induction hypothesis and definition of $\mathcal N^k$.
\end{proof}

\subsection{Proof of \texorpdfstring{Lemma \ref{lem:indkernel}}{the induction step}}

In this part we prove Lemma \ref{lem:indkernel}. Here we use several of the ideas developed in the companion paper \cite{ModulusOfContinuity}. In particular we will need \cite[Lemma 4.2]{ModulusOfContinuity} which we reproduce below.

\begin{lemma}[{\cite[Lemma 4.2]{ModulusOfContinuity}}]
  \label{lem:helper}
  Let $\mu \in \FunP \S X \S Y$. For any $\epsilon > 0$ there is a $\delta > 0$ s.t. if
  \begin{align*}
    \nu \in \Pr { \S X \times \S Y } & \text{ with } \W \mu \nu < \delta \text{ and} \\
    \gamma \in \Cpl \mu \nu      & \text{ with } {\textstyle \int} \rho(x_1,x_2)^p \d\gamma(x_1,y_1,x_2,y_2) < \delta^p
  \end{align*}
  then
  \begin{align*}
    {\textstyle \int} \rho(y_1,y_2)^p \d\gamma(x_1,y_1,x_2,y_2) < \epsilon^p \text{ .}
  \end{align*}
\end{lemma}

For easy reference we also restate Lemma \ref{lem:indkernel}.
\indkernel*

\begin{proof}[Proof of Lemma \ref{lem:indkernel}]
  Let $(\mu',\mu) \in \dom<> {\J \S A \S B \S Y}$. Let $\epsilon > 0$.

  Choose $\delta > 0$ according to Lemma \ref{lem:helper} with $\S X = \S A \times \S B$, i.e.\ s.t.\ for any $\nu \in \Pr { \S A \times \S B \times \S Y }$ with $\W \mu \nu < \delta$ and any $\gamma \in \Cpl \mu \nu$ with ${\textstyle \int} \rho(a_1,a_2)^p + \rho(b_1,b_2)^p \d\gamma(a_1,b_1,\_,a_2,b_2,\_) < \delta^p$ we have ${\textstyle \int} \rho(y_1,y_2)^p \d\gamma(\_,y_1,\_,y_2) < \epsilon^p$.

  Let $(\nu',\nu) \in \dom<>{\J \S A \S B \S Y}$ with $\max(\rho(\mu,\nu) , \rho(\mu',\nu')) < \min(\delta , \epsilon)$.

  This means we can find $\gamma' \in \Cpl {\mu'} {\nu'}$ with
  \begin{align}
    \label{eq:selgamma'}
    {\textstyle \int} \rho(a_1,a_2)^p + \W<> {\hat b_1} {\hat b_2}^p \d\gamma'(a_1,\hat b_1, a_2, \hat b_2) < \min(\delta^p , \epsilon^p) \text{ .}
  \end{align}

  \newcommand{\bar\mu}{\bar\mu}
  \newcommand{\bar\nu}{\bar\nu}
  Let $(a,b) \mapsto f_a(b)$ and $(a,b) \mapsto g_a(b): \S A \times \S B \rightarrow \S Y$ be measurable functions on whose graph $\mu$ and $\nu$, respectively, are concentrated. Let $\bar\mu := \J \S A \S B \S Y (\mu',\mu)$, $\bar\nu :=  \J \S A \S B \S Y (\nu', \nu)$.

  \newcommand{\dot\mu}{\dot\mu}
  \newcommand{\dot\nu}{\dot\nu}
  As noted in the proof of Lemma \ref{lem:functionsremainfunctions} we know that for $\bar\mu$-a.a.\ $(a,\dot\mu)$ the measure $\dot\mu$ is concentrated on the graph of the function $f_a$ (and similarly for $\bar\nu$).
  This together with $\push{\id \S A \times \push{\proj_\S B}}(\bar\mu) = \mu'$ (which is a consequence of \eqref{eq:mu'mu}) implies that
  \begin{align*}
    {\textstyle \int} h \d\bar\mu = {\textstyle \int} h\pa{a,\push{\id \S B \bm, f_a}(\hat b)} \d\mu'(a,\hat b)
  \end{align*}
  (again similarly for $\bar\nu$).

  \newcommand{\bar\gamma}{\bar\gamma}
  From this we see that the measure $\bar\gamma \in \Pr {\S A \times \FunP \S B \S Y \times \S A \times \FunP \S B \S Y}$ defined as
  \begin{align*}
    {\textstyle \int} h \d\bar\gamma :=
    {\textstyle \int} h\pa{a_1,\push{\id \S B \bm, f_{a_1}}(\hat b_1), a_2, \push{\id \S B \bm, g_{a_2}}(\hat b_2)} \d\gamma'(a_1,\hat b_1, a_2,\hat b_2)
  \end{align*}
  is in $\Cpl \bar\mu \bar\nu$.

  \newcommand{\hat\gamma_{\hat b_1,\hat b_2}}{\hat\gamma_{\hat b_1,\hat b_2}}
  We may measurably select almost-witnesses $\hat\gamma_{\hat b_1,\hat b_2} \in \Cpl<> {\hat b_1} {\hat b_2}$ for the distances $\W<> {\hat b_1} {\hat b_2}$ s.t.\ building on \eqref{eq:selgamma'} we get
  \begin{align}
    \label{eq:leftbound}
    {\textstyle \int} \rho(a_1,a_2)^p + {\textstyle \int} \rho(b_1,b_2)^p \d\hat\gamma_{\hat b_1,\hat b_2}(b_1,b_2) \d\gamma'(a_1,\hat b_1, a_2, \hat b_2) < \min(\delta^p , \epsilon^p) \text{ .}
  \end{align}
  \newcommand\dolabel[1]{\stepcounter{equation}\tag{\theequation}\label{#1}}
  \newcommand{\smash{\hat b}}{\smash{\hat b}}
  Now
  \begin{align*}
    & \rho(\bar\mu,\bar\nu)^p \leq {\textstyle \int} \rho_{\Pr { \S A \times \Pr { \S B \times \S Y} }}^p \d \bar\gamma \\
    & = {\textstyle \int} \rho(a_1,a_2)^p + \W { \push{\id \S B \bm, f_{a_1}}(\hat b_1) } { \push{\id \S B \bm, g_{a_2}}(\hat b_2) } ^p \d\gamma'(a_1,\smash{\hat b}_1,a_1,\smash{\hat b}_2) \\
    & \leq {\textstyle \int} \rho(a_1,a_2)^p + {\textstyle \int} \rho(b_1,b_2)^p + \rho\pa{f_{a_1}(b_1),g_{a_2}(b_2)}^p \d\hat\gamma_{\hat b_1,\hat b_2}(b_1,b_2) \d\gamma'(a_1,\smash{\hat b}_1,a_2,\smash{\hat b}_2) \\
    & = {\textstyle \int} \rho(a_1,a_2)^p + \rho(b_1,b_2)^p + \rho(y_1,y_2)^p \d\gamma(a_1,b_1,y_1,a_2,b_2,y_2) \dolabel{eq:tobebounded}
  \end{align*}
  where $\gamma \in \Cpl \mu \nu$ is defined as
  \begin{align*}
    {\textstyle \int} h \d\gamma = {\textstyle \iint} h\pa{a_1,b_1,f_{a_1}(b_1),a_2,b_2,g_{a_2}(b_2)} \d\hat\gamma_{\hat b_1,\hat b_2}(b_1,b_2) \d\gamma'(a_1,\smash{\hat b}_1,a_2,\smash{\hat b}_2) \text{ .}
  \end{align*}
  The integral over the first two summands in \eqref{eq:tobebounded} is less than $\min(\delta^p , \epsilon^p)$ by \eqref{eq:leftbound}. By our choice of $\delta$ in the beginning this implies that the integral over the last summand is also less than $\epsilon^p$, so that overall
  \begin{align*}
    \rho(\bar\mu,\bar\nu)^p < 2 \epsilon^p \text{ .}
  \end{align*}
  Es $\epsilon$ was arbitrary this concludes the proof.
\end{proof}

\section{The symmetrized causal Wasserstein distance\texorpdfstring{ $\mathcal S \mathcal C \mathcal W_p$}{}}
\label{sec:CausalAndAnti}

In this section we prove that the topology induced by $\mathcal S \mathcal C \mathcal W_p$ is sandwiched between Hellwig's $\mathcal W_p$-information topology and the topology induced by $\mathcal A \mathcal W_p$, and therefore by what we have already seen in the previous section equal to both of them.
Our arguments in this section make explicit use of metrics. The reader who is only interested in the simpler version of our main theorem, Theorem \ref{thm:main_simple} may assume that $p = 1$ and that all metrics are bounded.

Remember that for $\mu, \nu \in \Pr \overline X$ we have
\begin{align}
  \label{eq:WcDef}
  \mathcal C \mathcal W_p(\mu,\nu)^p  & = \inf_{\substack{\gamma \in \Cpl \mu \nu \\ \gamma \text{ causal}}} \int \sum_{t=1}^N \rho(x_t,y_t)^p \d\gamma((x_t)_t,(y_t)_t) \\
  \mathcal S \mathcal C \mathcal W_p(\mu,\nu) & = \max\pa{\mathcal C \mathcal W_p(\mu,\nu),\mathcal C \mathcal W_p(\nu,\mu)} \\[2mm]
  \mathcal A \mathcal W_p(\mu,\nu)^p  & = \inf_{\substack{\gamma \in \Cpl \mu \nu \\ \gamma \text{ bicausal}}} \int \sum_{t=1}^N \rho(x_t,y_t)^p \d\gamma((x_t)_t,(y_t)_t) \text{ .}
\end{align}

In proving this we will take a slightly roundabout route. First we will focus on the case where $\overline X = \S X_1 \times \S X_2$ is the product of just two spaces, i.e.\ where we have only two time points. Moreover, for expositional purposes, let us for the moment assume that $\S X_1$ and $\S X_2$ are both compact. Generalizing from this setting will not be very hard.

In the compact, two-time-point case we will show equality of the two topologies in question by extending both to a larger (compact) space and showing equality of the topologies on that larger space.

In more detail:

When there are only two timepoints Hellwig's $\mathcal W_p$-information topology and the topology induced by $\mathcal A \mathcal W_p$ trivially coincide. Both are induced by emedding $\Pr {\S X_1 \times \S X_2}$ into $\Pr {\S X_1 \times \Pr{\S X_2}}$ via $\disint {\S X_1} {\S X_2}$. The latter space carries its standard metric $\rho_{\Pr {\S X_1 \times \Pr{\S X_2}}}$, which -- as was already established in Theorem \ref{thm:Nembedding} in Section \ref{sec:DerErhabeneRaum} of the introduction -- is an extension of $\mathcal A \mathcal W_p$. To highlight this connection, in this section we will also refer to that metric as $\overb{8}{7}{\mathcal A \mathcal W_p}$. As a reminder,
\begin{align*}
  \WWb \mu \nu ^p =  \inf_{\gamma \in \Cpl \mu \nu} \int \rho(x_1,y_1)^p + \W {\xi_2} {\eta_2} ^p \d \gamma(x_1, \xi_2, y_1, \eta_2)
\end{align*}
where $\mathcal W_p$ is the normal Wasserstein distance (on $\Pr {\S X_2}$ in this case).
We will find an extension $\overb{5}{6}{\mathcal C \mathcal W_p}$ of $\mathcal C \mathcal W_p$ to $\Pr {\S X_1 \times \Pr{\S X_2}}$, which still satisfies all properties of a metric except for symmetry and which is dominated by $\overb{8}{7}{\mathcal A \mathcal W_p}$. Symmetrizing this extension gives a metric (which we will call $\overb{5}{6}{\mathcal S \mathcal C \mathcal W_p}$). The identity function from $\Pr {\S X_1 \times \Pr{\S X_2}}$ topologized with $\overb{8}{7}{\mathcal A \mathcal W_p}$ to $\Pr {\S X_1 \times \Pr{\S X_2}}$ topologized with $\overb{5}{6}{\mathcal S \mathcal C \mathcal W_p}$ will then be a continuous bijection from a compact space (this is where we use compactness of $\S X_1$, $\S X_2$) to a \emph{Hausdorff} space, i.e.\ a homeomorphism.

The next subsection will be devoted to finding an expression for the extension of $\mathcal C \mathcal W_p$ to $\Pr {\S X_1 \times \Pr{\S X_2}}$ and proving that it satisfies all the properties mentioned above.

\begin{remark}
  When $\S X_1$ contains no isolated points, because $\Pr {\S X_1 \times \Pr{\S X_2}}$ is the metric completion of $\Pr {\S X_1 \times \S X_2}$ w.r.t.\ $\mathcal A \mathcal W_p$ and because the above properties imply that $\mathcal C \mathcal W_p$ is (uniformly) continuous w.r.t.\ $\mathcal A \mathcal W_p$, we have already uniquely identified $\overb{5}{6}{\mathcal C \mathcal W_p}$. Still, we want to find an expression that allows us to work with $\overb{5}{6}{\mathcal C \mathcal W_p}$ and in particular that allows us to prove that $\overb{5}{6}{\mathcal S \mathcal C \mathcal W_p}$ is a metric and not just a pseudometric, i.e.\ that the induced topology is in fact Hausdorff.
  This is exactly what we gain from assuming compact base spaces and passing to the completion: instead of having to find a lower bound for $\Wca \mu \nu$ in terms of $\Wb \mu \nu$ (and possibly $\mu$) we now just have to prove that if $\mu \neq \nu$ then $\WWca \mu \nu > 0$.
\end{remark}

  {\color{black}For definiteness we note that  we do \emph{not} assume,  compactness of any space in the following.}

\subsection{Extending the causal \texorpdfstring{`distance'}{'distance'}}

So now we are working with two Polish metric spaces $\S X_1$, $\S X_2$.
Remember that we denote the \enquote*{canonical process} on $\overline X := \S X_1 \times \S X_2$ by $(\RV X_i)_{i=1,2}$, i.e.\ $\RV X_i : \overline X \rightarrow \S X_i$ is the projection onto the $i$-th coordinate.

To differentiate between the different roles that $\overline X$ may play - i.e.\ is it the space for the left measure $\mu$ or the right measure $\nu$ when measuring the \enquote*{distance} $\Wc \mu \nu$ - we will also refer to $\overline X$, $\S X_i$ by the aliases $\Yb$, $\S Y_i$ respectively. (And later $\Zb$, $\S Z_i$ as well.)
Analogously, we have $\RV Y_i : \Yb \rightarrow \S Y_i$. (And $\RV Z_i : \Zb \rightarrow \S Z_i$.)

In this section we will repeatedly make use of the following construction:
\begin{definition}
  \label{def:dpro}
  Let $\S A$, $\S B$, $\S C$ be Polish metric spaces.
  Let $\mu \in \Pr {\S A \times \S B}$ and $\nu \in \Pr {\S B \times \S C}$ with $\marg \mu \S B = \marg \nu \S B$.
  We define
  \begin{align*}
    \mu \dpro{\S B} \nu \in \Pr {\S A \times \S B \times \S C}
  \end{align*}
  as the measure given by
  \begin{align}
    \label{eq:dpro}
    \begin{aligned}
    {\textstyle \int} h \d(\mu \dpro \S B \nu)
    & := {\textstyle \int} h(a,b,c) \d\nu_b(c) \d\mu(a,b) \\
    & \phantom{:}= {\textstyle \int} h(a,b,c) \d\mu_b(a) \d\nu(b,c)
    \end{aligned}
  \end{align}
  where $b \mapsto \nu_b$ is a disintegration of $\nu$ w.r.t.\ $\S B$ and similarly for $\mu$.

  We further define
  \begin{align*}
    \mu \mcmo{\S B} \nu := \marg {\pa{\mu \dpro{\S B} \nu}} {\S A \times \S C} \in \Pr {\S A \times \S C} \text{ .}
  \end{align*}
\end{definition}

\begin{remark}
  If $\mu$ is a probability on $\S A \times \S B$ and $\nu$ is a probability on $\S B \times \S C$, another way of saying what $\mu \dpro{\S B} \nu$ is, is to state that it is a probability on $\S A \times \S B \times \S C$ s.t.\ the law of $(\RV A, \RV B)$ is equal to $\mu$, the law of $(\RV B, \RV C)$ is equal to $\nu$ (where per our convention $\RV A$ is the projection onto $\S A$, etc.), and $\RV A$ is conditionally independent from $\RV C$ given $\RV B$. (For the notion of conditional independence see for example \cite[Definition II.43]{DeMeA}.)

  Another helpful intuition comes from looking at the case where $\mu \in \FunP \S A \S B$ is concentrated on the graph of some measurable function $f: \S A \rightarrow \S B$ and $\nu \in \FunP \S B \S C$ is concentrated on the graph of a measurable function $g: \S B \rightarrow \S C$.
  $\mu \mcmo \S B \nu$ is then concentrated on the graph of $g \circ f : \S A \rightarrow \S C$.
  In some contexts $g \circ f$ is also written as $f \mcmp g$, which is where we borrowed the symbol from.
\end{remark}

\begin{remark}
  We will often encounter the situation that one of the factors $\S A$, $\S B$ or $\S C$ in Definition \ref{def:dpro} is itself a product of spaces and the individual factors may not always be so nicely sorted. We will rely on naming in the subscript the space(s) along which to join the measures $\mu$ and $\nu$. For example if $\mu \in \Pr {\S A_1 \times \S B_1 \times \S A_1 \times \S B_2}$ and $\nu \in \Pr {\S B_2 \times \S C_1 \times \S B_1 \times \S C_2}$ we might write
  \begin{align*}
    \mu \dpro{\S B_1,\S B_2} \nu \in \Pr {\S A_1 \times \S B_1 \times \S A_2 \times \S B_2 \times \S C_1 \times \S C_2}
  \end{align*}
  to refer to the measure that we get when in \eqref{eq:dpro} we use $(b_1,b_2) \in \S B_1 \times \S B_2$ as the middle variable $b$.
  We will not be systematic about the order of the factors in the resulting product space on which e.g.\ $\mu \dpro{\S B_1,\S B_2} \nu$ is a measure, again relying on naming our spaces for disambiguation.
\end{remark}

For future reference we paraphrase the definition of a causal transport plan given in \eqref{def:adapted.coupling} in the introduction.
\begin{lemma}
  \label{lem:causaldef}
  Let $\mu$ be a measure on $\overline X = \S X_1 \times \S X_2$ and $\nu$ be a measure on $\Yb = \S Y_1 \times \S Y_2$. $\gamma \in \Cpl \mu \nu$ is a causal transference plan from $\mu$ to $\nu$ iff under $\gamma$
  \begin{align*}
    \text{$\RV X_2$ and $\RV Y_1$ are conditionally independent given $\RV X_1$.}
  \end{align*}
\end{lemma}
\begin{proof}
  One way of formulating conditional independence is as in \eqref{def:adapted.coupling}, see for example \cite[Definition II.43, Theorem II.45]{DeMeA}.
\end{proof}

In other words, $\gamma \in \Cpl \mu \nu$ is a causal transference plan iff $\marg \gamma {\S X_1,\S X_2,\S Y_1} = \mu \dpro{\S X_1} \marg \gamma {\S X_1,\S Y_1}$.

We start by reexpressing $\mathcal C \mathcal W_p$ in different ways until we find one which also makes sense in $\Pr { \S X_1 \times \Pr {\S X_2}}$.

Let $\mu \in \Pr \overline X$ and $\nu \in \Pr \Yb$. Then

\newcommand{\Cstr}[1]{C_{#1}}
\begin{align*}
  \Wc \mu \nu ^p & = \inf_{\substack{\gamma \in \Cpl \mu \nu \\ \gamma \text{ causal}}} \int \rho(x_1,y_1)^p + \rho(x_2,y_2)^p \d \gamma(x_1,x_2,y_1,y_2) \\
      & = \inf_{\gamma \in \Cstr 1} \int \rho(x_1,y_1)^p + \rho(x_2,y_2)^p \d \gamma(x_1,x_2,y_1,y_2)
    \intertext{ where }
    \Cstr 1 & = \set {\gamma \in \Cpl \mu \nu}[\gamma = \pa{ \mu \dpro{\S X_1} \marg \gamma {\S X_1,\S Y_1} } \dpro{\S X_2,\S Y_1} \marg \gamma {\S X_2, \S Y_1, \S Y_2}] \text{ .}
\end{align*}
This is true because, on the one hand clearly a $\gamma \in \Cstr 1$ is causal by Lemma \ref{lem:causaldef} and the alternative characterization of $\dpro{\S X_1}$. On the other hand, given any causal $\gamma \in \Cpl \mu \nu$, again by Lemma \ref{lem:causaldef}, $\marg \gamma {\S X_1,\S X_2,\S Y_1} = \mu \dpro{\S X_1} \marg \gamma {\S X_1,\S Y_1}$, and we may define $\gamma' := \pa{ \mu \dpro{\S X_1} \marg \gamma {\S X_1,\S Y_1} } \dpro{\S X_2,\S Y_1} \marg \gamma {\S X_2, \S Y_1, \S Y_2} \enskip \in \Cpl \mu \nu$.
Now $\marg \gamma {\S X_1,\S X_2,\S Y_1} = \marg {\gamma'} {\S X_1,\S X_2,\S Y_1}$ and $\marg \gamma {\S X_2,\S Y_1,\S Y_2} = \marg {\gamma'} {\S X_2,\S Y_1,\S Y_2}$, so in particular
\begin{multline*}
  \int \rho(x_1,y_1)^p + \rho(x_2,y_2)^p \d \gamma(x_1,x_2,y_1,y_2) = \\ \int \rho(x_1,y_1)^p + \rho(x_2,y_2)^p \d \gamma'(x_1,x_2,y_1,y_2) \text{ .}
\end{multline*}

We may name the different building blocks of $\gamma \in \Cstr 1$ to get
\begin{align*}
  \Wc \mu \nu ^p =
  \inf_{(\gamma,\beta) \in \Cstr 2} \int \rho(x_1,y_1)^p \d \gamma(x_1,y_1) + \int \rho(x_2,y_2)^p \d \beta(y_1,x_2,y_2)
\end{align*}
with
\begin{multline*}
  \Cstr 2 = \set<\Big>{(\gamma,\beta) \in \Cpl{\marg \mu {\S X_1}}{\marg \nu {\S Y_1}} \times \Pr {\S Y_1 \times \S X_2 \times \S Y_2}}[\\\marg \beta {\S X_2, \S Y_1} = \mu \mcmo{\S X_1} \gamma \text{ and } \marg \beta {\S Y_1,\S Y_2} = \nu] \text{ ,}
\end{multline*}
i.e.\ there is a bijection between $\Cstr 1$ and $\Cstr 2$ given by sending $\gamma' \in \Cstr 1$ to $(\gamma, \beta) \in \Cstr 2$ where $\gamma := \marg {\gamma'} {\S X_1,\S Y_1}$, $\beta := \marg {\gamma'} {\S X_2,\S Y_1,\S Y_2}$, and, in the other direction, by sending $(\gamma, \beta) \in \Cstr 2$ to $\gamma' := \pa{ \mu \dpro{\S X_1} \gamma } \dpro{\S X_2,\S Y_1} \beta$.

We can apply the bijection $\diso {\S Y_1} : \Pr {\S Y_1 \times \S X_2 \times \S Y_2} \rightarrow \FunP {\S Y_1} {\Pr {\S X_2 \times \S Y_2}}$ to $\beta$. Translating the conditions on $(\gamma,\beta) \in \Cstr 2$ to conditions on $(\gamma, \diso {\S Y_1} (\beta))$ we arrive at
\begin{align*}
  \Wc \mu \nu ^p =
  \inf_{(\gamma,\beta) \in \Cstr 3} \int \rho(x_1, y_1)^p \d \gamma + \int \int \rho(x_2,y_2)^p \d \beta'(x_2,y_2) \d \beta(y_1, \beta')
\end{align*}
where
\begin{multline*}
  \Cstr 3 = \set<\Big>{(\gamma,\beta) \in \Cpl{\marg \mu {\S X_1}}{\marg \nu {\S Y_1}} \times \FunP {\S Y_1} {\Pr {\S X_2 \times \S Y_2}}}[ \\ \push{\id{\S Y_1} \times \push{\RV Y_2}}(\beta) = \diso {\S Y_1} (\nu) \text{ and } \\ \push{\id{\S Y_1} \times \push{\RV X_2}}(\beta) = \diso {\S Y_1} \pa{ \gamma \mcmo{\S X_1} \mu } ] \text{ .}
\end{multline*}

Let $(\gamma, \beta) \in \Cstr 3$ and let $(y_1, \beta') \mapsto \tilde \beta ' _{y_1, \beta'}$ be a measurable mapping with $\tilde \beta ' _{y_1, \beta'} \in \Cpl {\marg {\beta'} {\S X_2}} {\marg {\beta'} {\S Y_2}}$ for $\beta$-a.a.\ $(y_1,\beta')$. Then we have that also $(\gamma,\tilde\beta) \in \Cstr 3$, where $\tilde\beta \in \FunP {\S Y_1} {\Pr {\S X_2 \times \S Y_2}}$ is defined by
\begin{align*}
  \tilde\beta := f \mapsto \int f(y_1,\tilde\beta'_{y_1,\beta'}) \d \beta(y_1,\beta') \text{ .}
\end{align*}

By employing a $\beta$-a.e.\ measurable selector this implies that
\begin{align*}
  \Wc \mu \nu ^p & =
  \inf_{(\gamma,\beta) \in \Cstr 3} {\textstyle \int} \rho(x_1, y_1)^p \d \gamma + {\textstyle \int} \quad \inf_{\raisebox{0pt}[1.1em][0em]{}\mathclap{\substack{\tilde \beta' \in \\ \Cpl {\marg {\beta'} {\S X_2}} {\marg {\beta'} {\S Y_2}}}}} \quad {\textstyle \int} \rho(x_2,y_2)^p \d \tilde\beta'(x_2,y_2) \d \beta(y_1, \beta') \\[2mm]
  & = \inf_{(\gamma,\beta) \in \Cstr 3} {\textstyle \int} \rho(x_1, y_1)^p \d \gamma + {\textstyle \int} \quad \W {\marg {\beta'} {\S X_2}} {\marg {\beta'} {\S Y_2}} ^p \d \beta(y_1, \beta')
  \text{ .}
\end{align*}

We need
\begin{lemma}
  \label{lem:conddetimplcondind}
  If $\kappa \in \Pr {\S A \times \S B}$ and $\lambda \in \FunP {\S B} {\S C}$ then the only measure $\eta \in \Pr {\S A \times \S B \times \S C}$ with $\marg \eta {\S A \times \S B} = \kappa$ and $\marg \eta {\S B \times \S C} = \lambda$ is $\kappa \dpro{\S B} \lambda$.
\end{lemma}
\begin{proof}
  If $\eta$ satisfies the properties above and $b \mapsto \kappa_b$, $b \mapsto \lambda_b$ are (classical) disintegrations of $\kappa$, $\lambda$ w.r.t.\ $\S B$, then a (classical) disintegration $b \mapsto \eta_b$ of $\eta$ w.r.t.\ $\S B$ has to satisfy $\marg {{\eta_b}} \S A = \kappa_b$ and $\marg {{\eta_b}} \S C = \lambda_b$ a.s. As $\lambda_b$ is a Dirac measure a.s.\ this forces $\eta_b$ to be $\kappa_b \otimes \lambda_b$ almost surely.
\end{proof}

This implies that for $(\gamma, \beta) \in \Cstr 3$ the distribution of
\begin{align}
  \label{eq:cstr4}
  (y_1,\beta') \mapsto (y_1, {\marg {\beta'} {\S X_2}}, {\marg {\beta'} {\S Y_2}})
\end{align}
under $\beta$ is already determined by $\gamma$, i.e.\ because the distribution of $(y_1,\beta') \mapsto (y_1, {\marg {\beta'} {\S X_2}})$ is $\diso {\S Y_1} \!\!\pa{ \gamma \mcmo{\S X_1} \mu }$ and the distribution of $(y_1,\beta') \mapsto (y_1, {\marg {\beta'} {\S Y_2}})$ is $\diso {\S Y_1} \!(\nu)$,
the distribution of \eqref{eq:cstr4} under $\beta$ must be equal to
\begin{align*}
  \diso {\S Y_1} \!\!\pa{ \gamma \mcmo{\S X_1} \mu } \dpro{\S Y_1} \diso {\S Y_1} \!(\nu) \text{ .}
\end{align*}

This means that we may get rid of $\beta$:

\begin{multline*}
  \Wc \mu \nu ^p =
  \inf_{\mathclap{\gamma \in \Cpl { \marg \mu {\S X_1} } { \marg \nu {\S Y_1} } }} \quad {\textstyle \int} \rho(x_1,y_1)^p \d \gamma \\ + {\textstyle \int} \W {\mu'} {\nu'} ^p \d \pa { \diso {\S Y_1} \!\!\pa{ \gamma \mcmo{\S X_1} \mu } \dpro{\S Y_1} \diso {\S Y_1} \!(\nu) } (y_1,\mu',\nu')
\end{multline*}

For the final step we need another lemma:

\begin{lemma}
  Let $\lambda \in \Pr { \S A \times \S B }$ and $\beta \in \Pr { \S B \times \S C }$. Let $\RV \smash{\hat C}$ denote the projection onto $\Pr \S C$. Then
  \begin{align*}
    \diso \S A \pa { \lambda \mcmo \S B \beta }
  \end{align*}
  is equal to the distribution of
  \begin{align*}
    (\RV A, \E[\eta]{\RV \smash{\hat C}}[\RV A] )
    & \text{ under }
    \eta := \lambda \dpro \S B \diso \S B (\beta) \text{ .}
  \end{align*}
\end{lemma}
\begin{proof}
  Let $a \mapsto \lambda_a$ be a version of the (classical) disintegration of $\lambda$ w.r.t.\ $\S A$ and let $b \mapsto \beta_b$ be a disintegration of $\beta$ w.r.t.\ $\S B$.

  As one easily checks, a version of the (classical) disintegration of $\lambda \mcmo \S B \beta$ w.r.t.\ $\S A$ is given by $a \mapsto \int \beta_b \d \lambda_a(b)$, so that $\diso \S A \pa { \lambda \mcmo \S B \beta }$ is equal to $$\push<\Big> {a \mapsto (a, {\textstyle \int} \beta_b \d \lambda_a(b))} (\marg \lambda \S A) \text{ .}$$

  By the same argument a version of the disintegration of $\lambda \mcmo \S B \diso \S B (\beta)$ w.r.t.\ $\S A$ is given by $h := a \mapsto \int \diso \S B (\beta)_b \d \lambda_a(b)$, where $b \mapsto \diso \S B (\beta)_b$ is a disintegration of $\diso \S B (\beta)$ w.r.t.\ $\S B$. But such a disintegration is given by $b \mapsto \delta_{\beta_b}$, (where $\delta_{\beta_b}$ is the dirac measure at $\beta_b$). So $h = a \mapsto \int \delta_{\beta_b} \d \lambda_a(b)$. This means (a version of) $\E[\eta]{\RV \smash{\hat C}}[\RV A]$ is given by
  \begin{align*}
    \E[\eta]{\RV \smash{\hat C}}[\RV A](a,\_,\_)
    = {\textstyle \int} \hat c \d ({\textstyle \int} \delta_{\beta_b} \d \lambda_a(b))(\hat c)
    = {\textstyle \iint} \hat c \d \delta_{\beta_b}(\hat c) \d \lambda_a(b) = {\textstyle \int} \beta_b \d \lambda_a(b) \text{ ,}
  \end{align*}
  so that the distribution of $(\RV A, \E[\eta]{\RV \smash{\hat C}}[\RV A] )$ under $\eta$ is also given by $$\push<\Big> {a \mapsto (a, {\textstyle \int} \beta_b \d \lambda_a(b))} (\marg \lambda \S A) \text{ .}$$
\end{proof}

Using this lemma with $\S A = \S Y_1$, $\S B = \S X_1$, $\S C = \S X_2$, $\lambda = \gamma$, $\beta = \mu$ and writing $\RV {\smash{\hat X_2}}$, $\RV {\smash{\hat Y_2}}$ for the projections onto $\Pr {\S X_2}$, $\Pr {\S Y_2}$ respectively, we find:
\begin{align*}
  \Wc \mu \nu ^p = \quad
  \inf_{\mathclap{\gamma \in \Cpl { \marg \mu {\S X_1} } { \marg \nu {\S Y_1} } }} \quad \E[\gamma]{\rho(\RV X_1, \RV Y_1)^p} + \E[\eta(\gamma)]{\W {\E[\eta(\gamma)]{\RV {\smash{\hat X_2}}}[\RV Y_1]} {\RV {\smash{\hat Y_2}}} ^p}
\end{align*}
where $\eta(\gamma) := \diso {\S X_1} (\mu) \dpro {\S X_1} \gamma \dpro {\S Y_1} \diso {\S Y_1} (\nu)$.

By Lemma \ref{lem:conddetimplcondind} the function $\eta : \Cpl { \marg \mu {\S X_1} } { \marg \nu {\S Y_1} } \rightarrow \Cpl {\diso {\S X_1} (\mu)} {\diso {\S Y_1} (\nu)}$ is a bijection, so we may as well write
\begin{align*}
  \Wc \mu \nu ^p = \quad
  \inf_{\mathclap{\gamma \in \Cpl {\diso {\S X_1} (\mu)} {\diso {\S Y_1} (\nu)}}} \quad \E[\gamma]{\rho(\RV X_1, \RV Y_1)^p} + \E[\gamma]{\W {\E[\gamma]{\RV {\smash{\hat X_2}}}[\RV Y_1]} {\RV {\smash{\hat Y_2}}} ^p} \text{ .}
\end{align*}

Finally, under any $\gamma \in \Cpl {\diso {\S X_1} (\mu)} {\diso {\S Y_1} (\nu)}$ we know that $\RV {\smash{\hat Y_2}}$ is almost surely equal to a function of $\RV Y_1$, so that the completions of the sigma-algebras generated by $\RV Y_1$ and $\RV \smash{\vec Y} := (\RV Y_1,\RV {\smash{\hat Y_2}})$ respectively are equal. This means that $\E[\gamma]{\RV {\smash{\hat X_2}}}[\RV Y_1] = \E[\gamma]{\RV {\smash{\hat X_2}}}[\RV \smash{\vec Y}]$ a.s.\ and we arrive at our final expression for $\Wc \mu \nu$:
\begin{align*}
  \Wc \mu \nu = \inf_{\gamma \in \Cpl {\diso {\S X_1} (\mu)} {\diso {\S Y_1} (\nu)}} \pa<\Big>{ \E<\big>[\gamma]{\rho(\RV X_1, \RV Y_1)^p + \mathcal W_p \pa{\E[\gamma]{\RV {\smash{\hat X_2}}}[\RV \smash{\vec Y}], \RV {\smash{\hat Y_2}}} ^p} }^{1/p} \text{ .}
\end{align*}

Now this expression is trivial to generalize to $\mu \in \Pr {\S X_1 \times \Pr {\S X_2}}$ and $\nu \in \Pr {\S Y_1 \times \Pr {\S Y_2}}$, i.e.\ for such $\mu$, $\nu$ we set
\begin{align}
  \label{eq:WcLifted}
    \WWc \mu \nu & := \inf_{\gamma \in \Cpl \mu \nu} \pa<\bigg>{ \E<\Big>[\gamma]{\rho(\RV X_1, \RV Y_1)^p + \mathcal W_p\pa<\big>{ \E[\gamma]{\RV {\smash{\hat X_2}}}[\RV \smash{\vec Y}], \RV {\smash{\hat Y_2}}} ^p} }^{1/p} \text{ .}
\end{align}

To summarize our discussion up to this point:
\begin{lemma} The function
  \begin{align*}
    \overb{5}{6}{\mathcal C \mathcal W_p} : \Pr {\S X_1 \times \Pr {\S X_2}}^2 \rightarrow \mathbb{R}_+
  \end{align*}
  as defined in \eqref{eq:WcLifted} is really an extension of
  \begin{align*}
    \mathcal C \mathcal W_p : \Pr {\S X_1 \times \S X_2}^2 \rightarrow \mathbb{R}_+
  \end{align*}
  as defined in \eqref{eq:WcDef} (when $\Pr {\S X_1 \times \S X_2}$ is embedded into $\Pr {\S X_1 \times \Pr {\S X_2}}$ via $\diso{\S X_1}$).
\end{lemma}

Next we promised to show
\begin{lemma}
  \label{lem:WcleqWb}
  $\overb{5}{6}{\mathcal C \mathcal W_p}$ is bounded by $\overb{8}{7}{\mathcal A \mathcal W_p}$, i.e.\
\begin{align*}
  \WWc \mu \nu \leq \inf_{\gamma \in \Cpl \mu \nu} \pa<\Big>{ \E<\big>[\gamma]{\rho(\RV X_1, \RV Y_1)^p + \mathcal W_p (\RV {\smash{\hat X_2}},\RV {\smash{\hat Y_2}})^p} }^{1/p} = \WWb \mu \nu \text{ .}
\end{align*}
\end{lemma}
\begin{proof}
  By the conditional version of Jensen's inequality applied to the convex function $(\hat x, \hat y) \mapsto \W {\hat x} {\hat y} ^p$ we have
  \begin{align*}
    \mathcal W_p \pa{ \E[\gamma]{\RV {\smash{\hat X_2}}}[\RV \smash{\vec Y}] , \RV {\smash{\hat Y_2}} }^p = \mathcal W_p \pa{ \E[\gamma]{ (\RV {\smash{\hat X_2}}, \RV {\smash{\hat Y_2}}) }[\RV \smash{\vec Y}] }^p \leq \E[\gamma]{ \W \RV {\smash{\hat X_2}} \RV {\smash{\hat Y_2}} ^p}[\RV \smash{\vec Y}] \text{ .}
  \end{align*}
\end{proof}

\begin{remark}
For the reader who may be sceptical of whether Jensen's inequality holds in this rather unusual setting, where we have a convex function
\begin{align*}
  \mathcal W_p : \Pr {\S X_2} \times \Pr {\S Y_2} \rightarrow \mathbb{R}_+
\end{align*}
and conditional expectations on spaces of measures we remark that for the Wasserstein distance in particular this is very easy to check. The proof is just integrating transport plans between $\RV {\smash{\hat X_2}}$ and $\RV {\smash{\hat Y_2}}$ w.r.t.\ the distribution of these conditioned on $\RV \smash{\vec Y}$ (in this case) to get transport plans between $\E[\gamma]{\RV {\smash{\hat X_2}}}[\RV \smash{\vec Y}]$ and $\E[\gamma]{\RV {\smash{\hat Y_2}}}[\RV \smash{\vec Y}]$.
\end{remark}

\begin{lemma}
  \label{lem:WcTriangle}
  Let $\mu, \nu, \lambda \in \Pr {\S X_1 \times \Pr {\S X_2}}$. Then
  \begin{align*}
    \WWc \mu \lambda \leq \WWc \mu \nu + \WWc \nu \lambda \text{ .}
  \end{align*}
\end{lemma}
\begin{proof}
  Using our naming convention we have $$\mu \in \Pr {\S X_1 \times \Pr {\S X_2}},\quad \nu \in \Pr {\S Y_1 \times \Pr {\S Y_2}},\quad \lambda \in \Pr {\S Z_1 \times \Pr {\S Z_2}} \text{ .}$$
  We denote the projections onto $\Pr {\S X_2}$, $\Pr {\S Y_2}$, $\Pr {\S Z_2}$ by $\RV {\smash{\hat X_2}}$, $\RV {\smash{\hat Y_2}}$, $\RV {\smash{\hat Z_2}}$ respectively. $\RV \smash{\vec Y} = (\RV Y_1,\RV {\smash{\hat Y_2}})$, $\RV \smash{\vec Z} := (\RV Z_1, \RV {\smash{\hat Z_2}})$.

  Let $\gamma \in \Cpl \mu \nu$ and $\eta \in \Cpl \nu \lambda$. In the following let $\mathbb E$ refer to (conditional) expectation w.r.t.\ $\kappa := \gamma \dpro {\S Y_1, \Pr {\S Y_2}} \eta$, and let $\Lpnorm{\cdot}$ refer to the $L_p$-norm w.r.t.\ $\kappa$.

  Combining the triangle inequalities for $\rho$, $\mathcal W_p$ and the $\Lpnorm \cdot$ we get
  \begin{align}
    \label{eq:LpD}
    \Lpnorm{\rho(\RV X_1,\RV Z_1)} & \leq \Lpnorm{\rho(\RV X_1,\RV Y_1)} + \Lpnorm{\rho(\RV Y_1,\RV Z_1)} \\
    \label{eq:LpW'}
    \Lpnorm{\W {\E{\RV {\smash{\hat X_2}}}[\RV \smash{\vec Z}]} {\RV {\smash{\hat Z_2}}}} & \leq \Lpnorm{\mathcal W_p \pa{\E{(\RV {\smash{\hat X_2}},\RV {\smash{\hat Y_2}})}[\RV \smash{\vec Z}]}} + \Lpnorm{\W {\E{\RV {\smash{\hat Y_2}}}[\RV \smash{\vec Z}]} {\RV {\smash{\hat Z_2}}}}
  \end{align}

  By the conditional Jensen inequality
  \begin{align*}
    \mathcal W_p \pa{\E{(\RV {\smash{\hat X_2}},\RV {\smash{\hat Y_2}})}[\RV \smash{\vec Z}]}^p & =
    \mathcal W_p \pa<\bigg>{ \E<\Big>{\E<\big>{(\RV {\smash{\hat X_2}},\RV {\smash{\hat Y_2}})}[\RV \smash{\vec Y},\RV \smash{\vec Z}]}[\RV \smash{\vec Z}] }^p \\ & \leq \E<\bigg>{ \mathcal W_p \pa<\Big> {\E<\big>{(\RV {\smash{\hat X_2}},\RV {\smash{\hat Y_2}})}[\RV \smash{\vec Y},\RV \smash{\vec Z}]}^p }[\RV \smash{\vec Z}]
  \end{align*}
  and therefore
  \begin{align*}
    \Lpnorm{ \mathcal W_p \pa{ \E{(\RV {\smash{\hat X_2}},\RV {\smash{\hat Y_2}})}[\RV \smash{\vec Z}]} }^p \leq \Lpnorm{ \mathcal W_p \pa{ \E{(\RV {\smash{\hat X_2}},\RV {\smash{\hat Y_2}})}[\RV \smash{\vec Y},\RV \smash{\vec Z}] }^p } \text{ .}
  \end{align*}
  By construction, $(\RV {\smash{\hat X_2}},\RV {\smash{\hat Y_2}})$ is conditionally independent from $\RV \smash{\vec Z}$ given $\RV \smash{\vec Y}$, so that $\E{(\RV {\smash{\hat X_2}},\RV {\smash{\hat Y_2}})}[\RV \smash{\vec Y},\RV \smash{\vec Z}] = \E{(\RV {\smash{\hat X_2}},\RV {\smash{\hat Y_2}})}[\RV \smash{\vec Y}]$ (this basic fact about conditional independence can be found for example as Theorem 45 in \cite{DeMeA}).
  Combining this with \eqref{eq:LpW'} gives
  \begin{align}
    \label{eq:LpW}
    \Lpnorm{\W {\E{\RV {\smash{\hat X_2}}}[\RV \smash{\vec Z}]} {\RV {\smash{\hat Z_2}}}} & \leq \Lpnorm{\W {\E{\RV {\smash{\hat X_2}}}[\RV \smash{\vec Y}]} {\RV {\smash{\hat Y_2}}} } + \Lpnorm{\W {\E{\RV {\smash{\hat Y_2}}}[\RV \smash{\vec Z}]} {\RV {\smash{\hat Z_2}}}} \text{ .}
  \end{align}
  Putting together \eqref{eq:LpD} and \eqref{eq:LpW} with the triangle inequality for $\ell_p$ we get
  \begin{align*}
    \Wc \mu \lambda & = \pa{ \Lpnorm{ \rho(\RV X_1,\RV Z_1) }^p + \Lpnorm{ \W {\E{\RV {\smash{\hat X_2}}}[\RV \smash{\vec Z}]} {\RV {\smash{\hat Z_2}}} }^p }^{1/p} \\
     & \leq \pa{ \Lpnorm{ \rho(\RV X_1,\RV Y_1) }^p + \Lpnorm{ \W {\E{\RV {\smash{\hat X_2}}}[\RV \smash{\vec Y}]} {\RV {\smash{\hat Y_2}}} }^p }^{1/p} \\
     & \qquad + \pa{ \Lpnorm{ \rho(\RV Y_1,\RV Z_1) }^p + \Lpnorm{ \W {\E{\RV {\smash{\hat Y_2}}}[\RV \smash{\vec Z}]} {\RV {\smash{\hat Z_2}}} }^p }^{1/p} \\
     & = \Wc \mu \nu + \Wc \nu \lambda \text{ .}
  \end{align*}
\end{proof}

\begin{lemma}
  $\overb{5}{6}{\mathcal C \mathcal W_p}$ is uniformly continuous w.r.t.\ $\overb{8}{7}{\mathcal A \mathcal W_p}$ on $\Pr {\S X_1 \times \Pr {\S X_2}}^2$.
\end{lemma}
\begin{proof}
  Let $\mu, \nu, \mu', \nu' \in \Pr {\S X_1 \times \Pr {\S X_2}}$. We repeatedly use Lemma \ref{lem:WcTriangle}:
  \begin{align*}
    \WWc \mu \nu \leq \WWc {\mu} {\nu'} + \WWc {\nu'} {\nu} \leq \WWc {\mu} {\mu'} + \WWc {\mu'} {\nu'} + \WWc {\nu'} {\nu}
  \end{align*}
  therefore
  \begin{align*}
    \WWc \mu \nu - \WWc {\mu'} {\nu'} \leq \WWc {\mu} {\mu'} + \WWc {\nu'} {\nu} \text{ .}
  \end{align*}
  Switching the roles of $(\mu,\nu)$ and $(\mu',\nu')$ implies
  \begin{align*}
    \lvert \WWc \mu \nu & - \WWc {\mu'} {\nu'} \rvert \\
     & \leq \max\pa{ \WWc {\mu} {\mu'} , \WWc {\mu'} {\mu} } + \max\pa{ \WWc {\nu} {\nu'} , \WWc {\nu'} {\nu} } \\
     & \leq \WWb {\mu} {\mu'} + \WWb {\nu} {\nu'} \text{ .}
  \end{align*}
\end{proof}

\begin{lemma}
  The infimum in \eqref{eq:WcLifted} is attained.
\end{lemma}
\begin{proof}
  This is an application of \cite[Theorem 1.2]{BaBePa18}.

  For self-containedness and because it's a nice application of the nested distance, we also sketch the argument here.
  We know that $\Cpl \mu \nu$ is compact. The problem is that $\gamma \mapsto \E[\gamma]{\W {\E[\gamma]{\RV {\smash{\hat X_2}}}[\RV \smash{\vec Y}]} {\RV \smash{\vec Y}} ^p}$ is not (lower semi-) continuous. But we may switch to a topology which is better \emph{adapted} to the problem at hand. Namely the two-timepoint $\mathcal A \mathcal W_p$-topology.
  In this case the space for the first timepoint is $\S Y_1 \times \Pr{\S Y_2}$ and that for the second is $\S X_1 \times \Pr{\S X_2}$. In effect that means that instead of $\gamma \in \Cpl \mu \nu$ we are now looking at $\gamma' \in \FunP { \S Y_1 \times \Pr {\S Y_2}} {\Pr{ \S X_1 \times \Pr {\S X_2}}}$. The function that we are optimizing over can be written as
  \begin{align*}
    \hat C := \gamma' &\mapsto \E[\gamma']{C(\RV Y_1,\RV {\smash{\hat Y_2}},\RV {\smash{\hat{\vec X}}})}
    \intertext{where}
    C(y_1, \hat y_2, \xi) &= \int \rho(x_1,y_1) \d\xi(x_1,\_) + \W { \bary(\marg \xi {\Pr {\S X_2}})} {\hat y_2} \\
    \bary(\lambda) & = \int x \d\lambda(x)
  \end{align*}
  $C$ is a continuous function and so is $\hat C$. Now  $\diso{\S Y_1 \times \Pr{\S Y_2}}\pa{\Cpl \mu \nu}$ is not compact, but
  \begin{multline*}
    \set<\Big>{\gamma' \in \Pr { \S Y_1 \times \Pr {\S Y_2} \times \Pr{ \S X_1 \times \Pr {\S X_2}}}}[ \\ \marg {\gamma'} {\S Y_1 \times \Pr {\S Y_2}} = \nu \, , \quad \marg{\undo {\S Y_1 \times \Pr {\S Y_2}} (\gamma')}{\Pr{ \S X_1 \times \Pr {\S X_2}}} = \mu]
  \end{multline*}
  is. So we can find a minimizer $\gamma'$ of $\hat C$ in this set. To return to $\Cpl \mu \nu$, or more precisely $\diso{\S Y_1 \times \Pr{\S Y_2}}\pa{\Cpl \mu \nu}$, we can send $\gamma'$ to the distribution $\gamma''$ of $(\RV Y_1,\RV {\smash{\hat Y_2}},\E[\gamma']{\RV {\smash{\hat{\vec X}}}}[\RV \smash{\vec Y}])$. Because $C$ is continuous and convex in its last argument and by (the conditional version of) Jensens inequality (which could again be proved \enquote*{by hand} here) $\hat C(\gamma'') \leq \hat C(\gamma')$. $\undo { \S Y_1 \times \Pr {\S Y_2}} (\gamma'')$ is the sought after minimizer of \eqref{eq:WcLifted}.
\end{proof}

\begin{lemma}
  \label{lem:Hausdorff}
  Let $\mu, \nu \in \Pr {\S X_1 \times \Pr {\S X_2}}$.
  Then $\WWc \mu \nu = \WWc \nu \mu = 0$ implies $\mu = \nu$.
\end{lemma}
\begin{proof}
  Call
  \begin{align*}
    \optsmash{\vec \Xs} & := \S X_1 \times \Pr {\S X_2} &
    \optsmash{\vec \Ys} & := \S Y_1 \times \Pr {\S Y_2} &
    \optsmash{\vec \Zs} & := \S Z_1 \times \Pr {\S Z_2} \text{ .}
  \end{align*}
  To have labels for our spaces, see $\mu, \nu$ as $$\mu \in \Pr {\optsmash{\vec \Xs}}\,, \quad\nu \in \Pr {\optsmash{\vec \Ys}}\,, \quad\mu \in \Pr {\optsmash{\vec \Zs}} \text{ .} $$

  Let $\gamma \in \Cpl \mu \nu \subseteq \Pr { \optsmash{\vec \Xs} \times \optsmash{\vec \Ys} }$ s.t.\ $\E[\gamma]{\rho(\RV X_1, \RV Y_1)^p} + \E[\gamma]{\W {\E[\gamma]{\RV {\smash{\hat X_2}}}[\RV \smash{\vec Y}]} {\RV {\smash{\hat Y_2}}} ^p} = 0$.

  Let $\eta \in \Cpl \nu \mu \subseteq \Pr { \optsmash{\vec \Ys} \times \optsmash{\vec \Zs}} $ s.t.\ $\E[\eta]{\rho(\RV Y_1, \RV Z_1)^p} + \E[\eta]{\W {\E[\eta]{\RV {\smash{\hat Y_2}}}[\RV \smash{\vec Z}]} {\RV {\smash{\hat Z_2}}} ^p} = 0$.

  \let\optsmash\identity
  All the following considerations happen under $\displaystyle \gamma \dpro { \optsmash{\vec \Ys} } \eta$.\let\optsmash\smash{}
  Clearly, $\RV Z_1 = \RV Y_1 = \RV X_1$ a.s.

  Moreover, because $\E {\RV {\smash{\hat X_2}}}[\RV \smash{\vec Y},\RV \smash{\vec Z}] = \E {\RV {\smash{\hat X_2}}}[\RV \smash{\vec Y}]$, the random variables $\RV {\smash{\hat Z_2}}, \RV {\smash{\hat Y_2}}, \RV {\smash{\hat X_2}}$ form a martingale w.r.t.\ the filtration generated by $\RV \smash{\vec Z}, \RV \smash{\vec Y}, \vec X$. The distribution of $\RV {\smash{\hat Z_2}}$ is equal to the distribution of $\RV {\smash{\hat X_2}}$. Both of these statements are also true if we integrate some bounded measurable function w.r.t.\ our random variables, i.e.\ for any bounded measurable $f : \S X_2 \rightarrow \mathbb{R} $ we have that $\int f \d\RV {\smash{\hat Z_2}}, \int f \d\RV {\smash{\hat Y_2}}, \int f \d\RV {\smash{\hat X_2}}$ is a martingale and that the distribution of $\int f \d\RV {\smash{\hat Z_2}}$ is equal to the distribution of $\int f \d\RV {\smash{\hat X_2}}$. But this means that we must have $\int f \d\RV {\smash{\hat Z_2}} = \int f \d\RV {\smash{\hat Y_2}} = \int f \d\RV {\smash{\hat X_2}}$ a.s.\ (Lemma \ref{lem:constMartingale} below). As this is true for all $f$ from a countable generator of the sigma-algebra on $\S X_2$, we have $\RV {\smash{\hat Z_2}} = \RV {\smash{\hat Y_2}} = \RV {\smash{\hat X_2}}$ a.s.
\end{proof}
\begin{lemma}
  \label{lem:constMartingale}
  Let $X_1, X_2, X_3$ be a bounded martingale over $\mathbb{R}$. If the distribution of $X_1$ is equal to the distribution of $X_3$ then $X_1 = X_2 = X_3$ a.s.
\end{lemma}
\begin{proof}
  This is a consequence of the strict version of Jensen's inequality applied to any everywhere strictly convex function. (Take for example $x \mapsto x^2$.)
\end{proof}

\begin{remark}
    The reason we took the detour of turning our probability-measure-valued martingale into a family of martingales on $\mathbb{R}$ and arguing on these is because this way we avoid having to exhibit a continuous, everywhere strictly convex function on $\Pr {\S X_2}$.
\end{remark}

As a reminder:
\begin{definition}
  For $\mu, \nu \in \Pr {\S X_1 \times \Pr {\S X_2}}$,
  \begin{align*}
    \WWca \mu \nu := \max(\WWc \mu \nu , \WWc \nu \mu) \text{ .}
  \end{align*}
\end{definition}

\begin{theorem}
  \label{thm:Wca}
  $\overb{5}{6}{\mathcal S \mathcal C \mathcal W_p}$ is a metric on $\Pr {\S X_1 \times \Pr {\S X_2}}$ satisfying $$\WWca \mu \nu \leq \WWb \mu \nu \text{ .}$$
\end{theorem}
\begin{proof}
  This follows from Lemma \ref{lem:WcTriangle}, Lemma \ref{lem:Hausdorff} and Lemma \ref{lem:WcleqWb}.
\end{proof}

\begin{remark}
  As outlined at the beginning of this section, {\color{black}and thanks to Theorem \ref{thm:Wca},}  we now know enough to conclude that the topology induced by $\mathcal S \mathcal C \mathcal W_p$ is equal to the topology induced by $\mathcal A \mathcal W_p$, {\color{black}in case both $\S X_1$ and $\S X_2$ were compact.}
  The non-compact case is not much harder. {\color{black}We now proceed to settle this case: For this} we need the following lemma.
\end{remark}

\begin{lemma}
  \label{lem:contraction}
  The map
  \begin{align*}
    \undo {\S X_1} : \Pr {\S X_1 \times \Pr {\S X_2}} \rightarrow \Pr {\S X_1 \times \S X_2}
  \end{align*}
  is a contraction when we equip the source space with $\overb{5}{6}{\mathcal S \mathcal C \mathcal W_p}$ and the target space with $\mathcal W_p$.
  More specifically for $\mu, \nu \in \Pr {\S X_1 \times \Pr {\S X_2}}$
  \begin{align}
    \label{eq:contraction}
    \W {\undo {\S X_1} (\mu)} {\undo {\S X_1} (\nu)} \leq \WWc \mu \nu \text{ .}
  \end{align}
\end{lemma}
\begin{proof}
  We prove the second statement.
  Let $\mu \in \Pr \optsmash{\vec \Xs}$, $\nu \in \Pr \optsmash{\vec \Ys}$.
  Given $\gamma \in \Cpl \mu \nu$ and $\epsilon > 0$ the task is to find $\gamma' \in \Cpl {\undo {\S X_1} \mu} {\undo {\S Y_1} \nu}$ s.t.\
  \begin{align}
    \label{eq:contrtarget}
    \E[\gamma']{\rho(\RV X_1,\RV Y_1)^p + \rho(\RV X_2,\RV Y_2)^p} \leq \E[\gamma]{\rho(\RV X_1, \RV Y_1)^p} + \E[\gamma]{\W {\E[\gamma]{\RV {\smash{\hat X_2}}}[\RV \smash{\vec Y}]} {\RV {\smash{\hat Y_2}}} ^p} + \epsilon \text{ .}
  \end{align}

  We take inspiration from the discussion at the beginning of this section.
  Let $\Xi : \optsmash{\vec \Xs} \times \optsmash{\vec \Ys} \rightarrow \Pr {\S X_2 \times \S Y_2}$ be a measurable selector satisfying
  \begin{align*}
    & \Xi \in \Cpl {\E[\gamma]{\RV {\smash{\hat X_2}}}[\RV \smash{\vec Y}]} {\RV {\smash{\hat Y_2}}} \quad \gamma\text{-a.s.\ and} \\
    & \E[\Xi]{\rho(\RV X_2,\RV Y_2)^p} \leq \W {\E[\gamma]{\RV {\smash{\hat X_2}}}[\RV \smash{\vec Y}]} {\RV {\smash{\hat Y_2}}}^p + \epsilon \quad \gamma\text{-a.s.}
  \end{align*}
  The obvious choice for $\gamma'$, namely $f \mapsto \E[\gamma]{\E[\Xi]{f(X_1,X_2,Y_1,Y_2)}}$ will not work because in general it gets the relationship between $X_1$ and $X_2$ wrong, i.e.\ its first marginal may not be $\undo {\S X_1} (\mu)$.
  Instead we again define $\gamma_L \in \Pr {\S X_1 \times \S X_2 \times \S Y_1}$ and $\gamma_R \in \Pr {\S X_2 \times \S Y_1 \times \S Y_2}$ and set $\gamma' := \gamma_L \dpro {\S X_2, \S Y_1} \gamma_R$.
  \begin{align*}
    \gamma_L & := f \mapsto \E<\big>[\gamma]{\E[\RV {\smash{\hat X_2}}]{f(\RV X_1,\RV X_2,\RV Y_1)}} \\
    \gamma_R & := f \mapsto \E[\gamma]{\E[\Xi]{f(\RV X_2,\RV Y_1,\RV Y_2)}}
  \end{align*}
  Clearly, if we can actually define $\gamma'$ as announced, then \eqref{eq:contrtarget} will hold, because then
  \begin{align*}
    \E[\gamma']{\rho(\RV X_1,\RV Y_1)} & = \E<\big>[\gamma]{\E[\RV {\smash{\hat X_2}}]{\rho(\RV X_1,\RV Y_1)}} = \E[\gamma]{\rho(\RV X_1,\RV Y_1)} \\
    \E[\gamma']{\rho(\RV X_2,\RV Y_2)} & = \E[\gamma]{\E[\Xi]{\rho(\RV X_2,\RV Y_2)}} \leq \E[\gamma]{\W {\E[\gamma]{\RV {\smash{\hat X_2}}}[\RV \smash{\vec Y}]} {\RV {\smash{\hat Y_2}}} ^p} + \epsilon \text{ .}
  \end{align*}
  It remains to check that $\gamma_L$ and $\gamma_R$ can actually be composed, i.e.\ that $(\RV X_2,\RV Y_1)$ has the same distribution under $\gamma_L$ and $\gamma_R$.
  \begin{multline*}
    \E[\gamma_R]{h(\RV X_2,\RV Y_1)} = \E[\gamma]{\E[\Xi]{h(\RV X_2,\RV Y_1)}} = \E[\gamma]{\E[{ \E[\gamma]{\RV {\smash{\hat X_2}}}[\RV \smash{\vec Y}] }]{h(\RV X_2,\RV Y_1)}} = \\ \E[\gamma]{\E<\Big>[\gamma]{ \E[\RV {\smash{\hat X_2}}]{h(\RV X_2,\RV Y_1)} }[\RV \smash{\vec Y}] } = \E[\gamma]{ \E[\RV {\smash{\hat X_2}}]{h(\RV X_2,\RV Y_1)} } = \E[\gamma_L]{h(\RV X_2,\RV Y_1)}
  \end{multline*}
  The step in the middle has its own Lemma \ref{lem:EEExpectation} below.
\end{proof}

\begin{lemma}
  \label{lem:EEExpectation}
  Let ${\mathbb P}$ be a probability on $\Pr \S X \times \S Y$, for Polish spaces $\S X, \S Y$. Let $h : \S X \times \S Y \rightarrow \mathbb{R}$ be a measurable function. Then
  \begin{align*}
    \E [{ \E{\smash{\hat X}}[Y] }] { h(X,Y) } = \E { \E[\hat X] { h(X,Y) } }[Y] \quad {\mathbb P}\text{-a.s.,}
  \end{align*}
  where $\mathbb E$ without superscript is the (conditional) expectiation w.r.t.\ ${\mathbb P}$ and $\hat X$ is the projection onto $\Pr \S X$.
\end{lemma}
 Note that $X$ is on both sides introduced by the expectation operator which carries a superscript, while $Y$ may on both sides be interpreted as coming from the outermost context. On the right hand side $Y$ may also be seen as having been introduced by the outermost conditional expectation operator. (As this operator conditions on $Y$ this is the same thing.)
\begin{proof}
  Both sides are clearly $Y$-measurable.
  We prove that for $h(x,y) = f(x) g_1(y)$, multiplying by $g_2(Y)$ and taking expectation gives the same result.
  By definition of the conditional expectation
  \begin{align*}
    \E { \E{\smash{\hat X}}[Y] g(Y) } = \E { \hat X g(Y) } \text{ .}
  \end{align*}
  Applying the continuous linear function $\gamma \mapsto \E[\gamma]{f(X)}$ this gives
  \begin{align*}
    \E { \E[{\E{\smash{\hat X}}[Y]}]{f(X)} g(Y) } = \E { \E[\smash{\hat X}]{f(X)} g(Y) } \text{ .}
  \end{align*}

  Again by the definition of the conditional expectation:
  \begin{multline*}
    \E {\E { \E[\hat X] { f(X)g_1(Y) } }[Y] g_2(Y)} =
    \E { \E[\hat X] { f(X)g_1(Y) } g_2(Y)} =  \\ \E { \E[\hat X] { f(X) } g_1(Y) g_2(Y) } = \E { \E[{\E{\smash{\hat X}}[Y]}]{f(X)} g_1(Y) g_2(Y) } = \\ \E { \E[{\E{\smash{\hat X}}[Y]}]{f(X) g_1(Y)} g_2(Y) }
  \end{multline*}
  where for the third equality we plugged in the previous equation.
\end{proof}

{%
\begin{proof}[Alternative proof of Lemma \ref{lem:contraction} when $\S X_1$ has no isolated points]
\let\optsmash\smash%
  When the space $\S X_1$ has no isolated points one can show that the space $\FunP {\S X_1} {\Pr {\S X_2}}$ is dense in $\Pr {\S X_1 \times \Pr {\S X_2}}$. This allows for a shorter proof of Lemma \ref{lem:contraction}:

  By the original definition \eqref{eq:WcDef} of $\mathcal C \mathcal W_p$ on the space $\Pr {\S X_1 \times \S X_2}$ the inequality \eqref{eq:contraction} holds on $\FunP {\S X_1} {\Pr {\S X_2}} \times \FunP {\S X_1} {\Pr {\S X_2}}$. Both $\mathcal C \mathcal W_p$ and $(\mu,\nu) \mapsto \W {\undo {\S X_1} (\mu)} {\undo {\S X_1} (\nu)}$ are uniformly continuous on $\Pr {\optsmash{\vec \Xs}} \times \Pr {\optsmash{\vec \Xs}}$ w.r.t.\ some product metric of $\overb{8}{7}{\mathcal A \mathcal W_p}$ with itself. $\FunP {\S X_1} {\Pr {\S X_2}}$ is dense in $\Pr {\optsmash{\vec \Xs}}$, and therefore $\FunP {\S X_1} {\Pr {\S X_2}} \times \FunP {\S X_1} {\Pr {\S X_2}}$ is dense in $\Pr {\optsmash{\vec \Xs}} \times \Pr {\optsmash{\vec \Xs}}$. This implies that \eqref{eq:contraction} holds on all of $\Pr {\optsmash{\vec \Xs}} \times \Pr {\optsmash{\vec \Xs}}$.
\end{proof}
}%

\begin{theorem}
  \label{thm:CausalAntiEqBi2}
  The topology induced by $\overb{5}{6}{\mathcal S \mathcal C \mathcal W_p}$ on $\Pr { \S X_1 \times \Pr {\S X_2} }$ is equal to the toplogy induced by $\overb{8}{7}{\mathcal A \mathcal W_p}$ on that space.
\end{theorem}
\begin{proof}
  As both topologies are metric and therefore first-countable we may argue on sequences.
  Let $(\mu_n)_n$ be a sequence in $\Pr { \S X_1 \times \Pr {\S X_2} }$. As $\WWca {\mu_n} \mu \leq \WWb {\mu_n} \mu$, if $(\mu_n)_n$ converges to $\mu$ w.r.t.\ $\overb{8}{7}{\mathcal A \mathcal W_p}$ it also converges to $\mu$ w.r.t.\ $\overb{5}{6}{\mathcal S \mathcal C \mathcal W_p}$.

  Now assume that a sequence $(\mu_n)_n$ in $\Pr { \S X_1 \times \Pr {\S X_2} }$ converges to $\mu$ w.r.t.\ $\overb{5}{6}{\mathcal S \mathcal C \mathcal W_p}$.
  We will show that every subsequence of $(\mu_n)_n$ has a subsequence which converges to $\mu$ w.r.t.\ $\overb{8}{7}{\mathcal A \mathcal W_p}$.

  {\color{black}
  Note that convergence of $(\mu_n)_n$ w.r.t.\ $\overb{5}{6}{\mathcal S \mathcal C \mathcal W_p}$ implies that the set $K := \set{ \mu_n }[n \in \mathbb{N}]$ is relatively compact w.r.t.\ the topology induced by $\overb{5}{6}{\mathcal S \mathcal C \mathcal W_p}$.}
  As $\undo {\S X_1}$ is continuous as a map from $\Pr { \S X_1 \times \Pr {\S X_2} }$ with the topology induced by $\overb{5}{6}{\mathcal S \mathcal C \mathcal W_p}$ to $\Pr {\S X_1 \times \S X_2}$ with the toplogy induced by $\mathcal W_p$ (Lemma \ref{lem:contraction}), we have that $\undo {\S X_1} [K] = \set{ \undo {\S X_1} (\mu_n) }[n \in \mathbb{N}]$ is also relatively compact.
  By Lemma \ref{lem:CompactnessLemma}/\cite[Lemma 3.3]{ModulusOfContinuity} this implies that $K$ is relatively compact in $\Pr {\S X_1 \times \Pr {\S X_2}}$ with the topology induced by $\overb{8}{7}{\mathcal A \mathcal W_p}$.
  Now let $(\mu_{n_k})_k$ be some subsequence of $(\mu_n)_n$.
  As $K$ is relatively compact we can find a subsequence $(\mu_{n_{k_j}})_j$ of $(\mu_{n_k})_k$, which converges w.r.t.\ $\overb{8}{7}{\mathcal A \mathcal W_p}$ to some $\mu' \in \Pr {\S X_1 \times \Pr {\S X_2} }$.
  As $\WWca {\mu_{n_{k_j}}} {\mu'} \leq \WWb {\mu_{n_{k_j}}} {\mu'}$ this sequence also converges to $\mu'$ w.r.t.\ $\overb{5}{6}{\mathcal S \mathcal C \mathcal W_p}$. But $(\mu_{n_{k_j}})_j$ also converges to $\mu$ w.r.t.\ $\overb{5}{6}{\mathcal S \mathcal C \mathcal W_p}$.
  Because the topology induced by $\overb{5}{6}{\mathcal S \mathcal C \mathcal W_p}$ is Hausdorff (Lemma \ref{lem:Hausdorff}), we must have $\mu' = \mu$, i.e.\ $(\mu_{n_{k_j}})_j$ converges to $\mu$ w.r.t.\ $\overb{8}{7}{\mathcal A \mathcal W_p}$.
\end{proof}

Now we return to the general case of $N$ time-points.

\begin{theorem}
  \label{thm:CausalAntiEqBiN}
  The topology induced by $\mathcal S \mathcal C \mathcal W_p$ on $\Pr {\overline X}$ is equal to Hellwig's $\mathcal W_p$-information topology and to the topology induced by $\mathcal A \mathcal W_p$.
\end{theorem}
\begin{proof}
  As every bicausal transport plan between $\mu$ and $\nu$ can be interpreted as a causal transport plan from $\mu$ to $\nu$ and also as a causal transport plan from $\nu$ to $\mu$ we have that $\Wca \mu \nu \leq \Wbc (\mu, \nu)$. This means that the identity from $\Pr \overline X$ with the topology induced by $\mathcal A \mathcal W_p$ to $\Pr \overline X$ with the topology induced by $\mathcal S \mathcal C \mathcal W_p$ is continuous.
  For the other direction we show that the identity from $\Pr \overline X$ with the topology induced by $\mathcal S \mathcal C \mathcal W_p$ to $\Pr \overline X$ with the $\mathcal W_p$-information topology is continuous, i.e.\ we show that each of the maps
  \begin{align*}
    \disint {\overline X^t} {\overline X_{t+1}} = \mathcal I_t : \Pr \overline X \rightarrow \FunP {\overline X^t} {\Pr{ \overline X_{t+1} }}
  \end{align*}
  is continuous when $\Pr \overline X$ gets the topology induced by $\mathcal S \mathcal C \mathcal W_p$.

  If $\mu, \nu \in \Pr {\overline X}$ and $\gamma \in \Cpl \mu \nu$ is causal, then, in particular, $\gamma$ is \enquote*{causal at the timestep from $t$ to $t+1$}, i.e.\ $\gamma$ is causal when regarded as a coupling between $\mu, \nu \in \Pr {\overline X^t \times \overline X_{t+1}}$.
  This means that if we define $\Wcac'$ like $\mathcal S \mathcal C \mathcal W_p$, but only require causality based on the decomposition of $\overline X$ as $\overline X^t \times \overline X_{t+1}$, then $\Wcac' (\mu,\nu) \leq \Wca \mu \nu$, i.e.\ the identity from $\Pr \overline X$ with the topology induced by $\mathcal S \mathcal C \mathcal W_p$ to $\Pr \overline X$ with the topology induced by $\Wcac'$ is continuous. By Theorem \ref{thm:CausalAntiEqBi2} the map
  \begin{align*}
    \disint {\overline X^t} {\overline X_{t+1}} : \Pr {\overline X^t \times \overline X_{t+1}} \rightarrow \FunP {\overline X^t} {\Pr {\overline X_{t+1}}}
  \end{align*}
  is continuous when we equip $\Pr {\overline X^t \times \overline X_{t+1}}$ with the topology induced by $\Wcac'$. Now $\mathcal I_t$ is continuous as a composite of continuous maps.
\end{proof}

\section{Aldous' extended weak convergence}
\label{sec:Aldous}

In this section we show that Aldous extended $\mathcal W_p$-/weak topology is equal to Hellwig's ($\mathcal W_p$-)information topology.

We recall and paraphrase here the definition, already given in the introduction, of Aldous' topology.

\newcommand{\dot\mu}[1]{\mu_{#1}}
\newcommand{\x}[2][i]{(x_{#1})_{#1=1}^{#2}}
\newcommand{\dirac}[1]{\delta_{#1}}
\begin{definition}
  Given $\mu \in \Pr \overline X$ let $\dot\mu {\x j}$ be the value of a (classical) disintegration of $\mu$ w.r.t.\ the first $j$ coordinates at $\x j$. (By convention $\dot\mu {\x 0} = \mu$).
  Define
  \begin{align*}
    \mathcal E & : \Pr \overline X \rightarrow \Pr { \overline X \times \prod_{j=0}^N \Pr \overline X } \\
    \mathcal E(\mu) & := \push{ \x N \mapsto \pa{ \x N , \pa{ \dirac {\x j} \otimes \dot\mu {\x j} }_{j=0}^N } } (\mu) \text{ .}
  \end{align*}
  The \emph{extended $\mathcal W_p-$/weak topology} on $\Pr \overline X$ is the initial topology w.r.t.\ $\mathcal E$.
\end{definition}
\begin{remark}
  Reasonable people may disagree about whether the most faithful / useful transcription of Aldous' definition should include the factors $j=0$ and $j=N$ in the above product of spaces. When including $j=N$, as we did, one has to interpret $\dirac {\x N} \otimes \dot\mu {\x N}$ simply as $\dirac {\x N}$. We leave it as an exercise to the reader to check that either or both may be dropped in the definition of $\mathcal E$ without affecting the resulting topology on $\Pr X$.
\end{remark}

\newcommand{\Alde}[1]{\mathcal A'_{#1}}
\newcommand{\mathcal A}{\mathcal A}
\begin{theorem}
  The ($\mathcal W_p$-)extended weak topology is equal to the ($\mathcal W_p$-)information topology.
\end{theorem}
\begin{proof}
  We construct continuous maps
  \begin{align*}
    \Alde k & : \Pr { \overline X \times \prod_{j=0}^N \Pr \overline X } \rightarrow \Pr { \overline X^k \times \Pr {\overline X_{k+1}} } \\
    \mathcal A & : \prod_{k=1}^{N-1} \FunP {\overline X^k} {\Pr{ \overline X_{k+1} }} \rightarrow \Pr { \overline X \times \prod_{j=0}^N \Pr \overline X } \\
  \end{align*}
  such that
  \begin{align*}
    \Alde k \circ \mathcal E & = \mathcal I_k \\
    \mathcal A \circ \mathcal I & = \mathcal E \text{ .}
  \end{align*}
  The first equality above implies that the identity on $\Pr \overline X$ is continuous from the extended weak topology to the information topology, the second implies that it is continuous in the other direction.

  $\Alde k$ is very simple. We just need to select the right factors and then discard the unnecessary $\dirac {\x k}$ part of the measure component. Formally
  \begin{align*}
    \Alde k := \push{ \big( \x N , (\nu_j)_{j=0}^N \big) \mapsto \big( \x k , \marg {{\nu_{k}}} {\overline X_{k+1}} \big) } \text{ ,}
  \end{align*}
  which is cleary continuous.

  We construct $\mathcal A$ recursively, by constructing as a composite of continuous maps
  \begin{align*}
    \mathcal A^m & : \prod_{k=1}^{N-1} \FunP {\overline X^k} {\Pr{ \overline X_{k+1} }} \rightarrow \Pr { \overline X^m \times \prod_{j=0}^m \Pr \overline X }
  \end{align*}
  satisfying
  \begin{align}
    \label{eq:aldindinv}
    \mathcal A^m(\mathcal I(\mu)) = \push{ \x N \mapsto \big( \x m , ( \dirac{\x k} \otimes \dot\mu{\x k} )_{k=0}^m \big) }(\mu) \text{ .}
  \end{align}
  $\mathcal A^0\pa{ (\nu_k)_{k=1}^{N-1} } := \dirac {\undo {\S X_1} (\nu_1)}$. We need the helper functions
  \begin{align*}
    h_m & : \FunP {\overline X^m} {\Pr {\overline X_{m+1}}} \rightarrow \FunP {\overline X^m} {\Pr \overline X} \\
    h_m & := \push{ (\x m, \rho) \mapsto (\x m , \dirac{\x m} \otimes \rho) } \text{ .}
  \end{align*}
  Given $\mathcal A^m$ satisfying the induction hypothesis we set
  \begin{align*}
    \mathcal A^{m+1}\pa{ (\nu_k)_{k=1}^{N-1} } := \push{ s_{m+1} } \pa{
      \mathcal A^m\pa{ (\nu_k)_{k=1}^{N-1} } \dpro{\overline X^m} h_{m+1}(\nu_{m+1})
    }
  \end{align*}
  where $s_{m+1}$ is the obvious permutation of the coordinates to get the factors into the right order.
  $\mathcal A^{m+1}$ is continuous because by \cite[Lemma 4.1]{ModulusOfContinuity} $\dpro{\overline X^m}$ is continuous when one of the arguments is an element of some $\FunP \S B \S C$. That \eqref{eq:aldindinv} still holds for $m+1$ is a straightforward calculation.
  This way we get to $\mathcal A^{N-1}$. Finally, set
  \begin{align*}
    \mathcal A\pa{ (\nu_k)_{k=1}^{N-1} } := \push{ s_N } \pa{ %
      \mathcal A^{N-1}\pa{ (\nu_k)_{k=1}^{N-1} } \dpro{\overline X^{N-1}} \diso{\S X_1}(\nu_1) %
    } \\
    \intertext{where}
    s_N\pa{ \pa{\x {N-1}, (\rho_j)_{j=1}^{N-1}, x_N} } := \pa{ \x {N}, (\rho_j)_{j=1}^{N-1}, \dirac{(\x {N})}} \text{ .}
  \end{align*}
\end{proof}

\section{Bounded vs unbounded metrics}
\label{sec:convergence.moments}

Because we will need it in the next section we interject here a proof of Lemma \ref{lem:convergence.moments}, which we restate below.

{\def{\overline X}{{\overline X}}
\convergencemoments*
}

\begin{proof}[Proof of Lemma \ref{lem:convergence.moments}]
  We provide the proof only for Hellwig's topology, i.e.\ \ref{it:Hellwig} of Theorem \ref{thm:main} and Theorem \ref{thm:main_simple}, respectively.
  As we have already seen in the previous sections, the topologies \ref{it:SCW}--\ref{it:Aldous} are equivalent topologies, and the result therefore carries over to them. The ($\mathcal W_p$-)optimal stopping topology, \ref{it:optstop}, is treated below.
  It is clear that convergence w.r.t.\ $\mathcal W_p$-information topology implies convergence in Hellwig'g information topology plus convergence of $p$-th moments.
  For the reverse implication, let $1\leq t\leq N-1$, and denote by $\mathcal{A}:=\overline{\mathcal{X}}^t$ the first $t$ and by $\mathcal{B}:=\overline{\mathcal{X}}_{t+1}$ the last $N-t$ coordinates.
  Now assume that $(\mu_n)_n$ converges to $\mu$ in Hellwig's information topology and that the $p$-th moments converge.
  The classical (not adapted) version of the very lemma we prove here implies that $\mu_n\to\mu$ in $\mathcal W_p$; in particular $K:=\{\mu_n: n\}\subset \Prp{\mathcal{A}\times\mathcal{B}}$ is relatively compact.
  Lemma \ref{lem:CompactnessLemma} (or really \cite[Lemma 3.3]{ModulusOfContinuity}/\cite[Lemma 2.6]{BaBePa18}) therefore guarantees that $\dis_\mathcal{A}^\mathcal{B} [K] \subset \Prp{\mathcal{A}\times\Prp{\mathcal{B}}}$ is relatively compact.

  Every subsequence of $(\disint \S A \S B (\mu_n))_n$ therefore has a subsequence $(\disint \S A \S B (\mu_{n_k}))_k$ which converges w.r.t.\ the topology on $\Prp {\S A \times \Prp \S B}$ (i.e.\ the one coming from nested Wasserstein metrics) to some $\mu' \in \Prp {\S A \times \Prp \S B}$. Because convergence in $\Prp {\S A \times \Prp \S B}$ is stronger than convergence in $\Pr {\S A \times \Pr \S B}$ (i.e.\ in the nested \emph{weak} sense) we must also have $\disint \S A \S B (\mu_{n_k}) \overset{k}{\to} \mu'$ in $\Pr {\S A \times \Pr \S B}$. But also, by assumption, $\disint \S A \S B (\mu_{n_k}) \overset{k}{\to} \disint \S A \S B (\mu)$ in $\Pr {\S A \times \Pr \S B}$ and therefore $\mu' = \disint \S A \S B (\mu)$.
\end{proof}

\section{Optimal Stopping}
\label{sec:OptStop}

In this section we investigate the relation between the ($\mathcal W_p$-)optimal stopping topology and the adapted Wasserstein topology.
Lemma \ref{lem:stopping.controlled.by.causal} states that the topology induced by $\mathcal A \mathcal W_p$ (\ref{it:AW} of Theorem \ref{thm:main}) is finer than the $\mathcal W_p$-optimal stopping topology.
Lemma \ref{lem:stopping.finer.than.information} states that the $\mathcal W_p$-optimal stopping topology is finer than the $\mathcal W_p$-information topology (\ref{it:Hellwig} of Theorem \ref{thm:main}).
This will finish the proof of Theorem \ref{thm:main}.

Recall that
\begin{align*}
  v^L(\mu):=\inf\set{\E[\mu] {L_\tau(X))}: 0\leq \tau\leq N\mbox{ is a stopping time} }
\end{align*}
for $L=(L_t)_{t=0}^N\in AC_p({\overline X})$.

\begin{lemma}
\label{lem:stopping.controlled.by.causal}
  Let $L\in AC_p({\overline X})$.
  Then $\mu\mapsto v^L(\mu)$ is continuous w.r.t.\ $\mathcal A \mathcal W_p$.
  In fact, one has
  \begin{align}
  \label{eq bound opt stopp}
  |v^L(\mu)-v^L(\nu)|\leq \inf\set{ \E[\pi] { \max_{0\leq t\leq N} |L_t(X)-L_t(Y)| } : \,\, \pi\in\Couplings_{bc}(\mu,\nu) }.
  \end{align}
  for every $\mu,\nu\in\Prp{{\overline X}}$.
\end{lemma}
\begin{proof}
  Let $\mu,\nu\in\Prp{{\overline X}}$ and assume that $v^L(\mu)\leq v^L(\nu)$.
  Moreover, let $\pi\in\Couplings_{bc}(\mu,\nu)$ and $\varepsilon>0$ be arbitrary, and fix a stopping time $\tau$ satisfying $\E[\nu]{L_{\tau}(Y)}\leq v^L(\nu)+\varepsilon$.
  For $u\in[0,1]$ define
  \begin{align*}
  \sigma(X,u)
  &:=\inf\{ t\in\{0,\cdots,T\}: \pi(\tau(Y)\leq t| X)\geq u\} \\
  &\phantom{:}= \inf\{ t\in\{0,\cdots,T\} : \pi(\tau(Y)\leq t| X_1,\dots,X_t)\geq u\},
  \end{align*}
  where the equality holds by the properties of stopping times and since $\pi$ is causal.
  We then have that
  \begin{align*}
  \int_{[0,1]}\E[\pi]{ L_{\sigma(X,u)}(X)} \d u \
  &= \sum_{t=0}^T \int_{[0,1]}\E[\pi]{ L_t(X)1_{\pi(\tau(Y)\leq t| X)\geq u >\pi(\tau(Y)\leq t-1 | X) } } \d u \\
  & =\sum_{t=0}^T \E[\pi] {L_t(X)1_{\tau(Y)=t} }
  = \E[\pi] {L_{\tau(Y)}(X) }.
  \end{align*}
  As further $\sigma(\cdot,u)$ is a stopping time for every fixed $u\in[0,1]$ one has $v^L(\mu)\leq \int_{[0,1]}\E[\pi] {L_{\sigma(X,u)}(X) } \d u$ and therefore
  \begin{align*}
  v^L(\mu)- v^L(\nu)
  &\leq \E[\pi] {L_{\tau(Y)}(X) - L_{\tau(Y)}(Y) } +\varepsilon\\
  &\leq \E[\pi] { \max_{0\leq t\leq N} |L_t(X) - L_t(Y) | } +\varepsilon.
  \end{align*}
  Changing the role of $\mu$ and $\nu$ and using that $\varepsilon>0$ and $\pi\in\Couplings_{bc}(\mu,\nu)$ was arbitrary yields \eqref{eq bound opt stopp}.

  Now assume that
  $\mathcal A \mathcal W_p(\mu_n,\mu) \to 0$
  and that $\pi_n \in \Cpl {\mu_n} \mu$ is less than $1/n$ away from attaining the infimum $\mathcal A \mathcal W_p(\mu_n,\mu)$.
  Then $\mathcal W_p(\pi_n, \pi) \to 0$, where $\pi \in \Cpl \mu \mu$ is the identity coupling $\push {\id {\overline X} \bm, \id {\overline X}} (\mu)$ of $\mu$. (A coupling between $\pi_n$ and $\pi$ is given by $\push {(x,y) \mapsto (x,y,y,y)}(\pi_n)$.) Because $(x,y) \mapsto \max_{0\leq t\leq N} |L_t(x)-L_t(y)|$ is a continuous function of growth of at most order $p$, we get that
  \begin{align*}
    \E[\pi_n] { \max_{0\leq t\leq N} |L_t(X)-L_t(Y)| } \to \E[\pi] { \max_{0\leq t\leq N} |L_t(X)-L_t(Y)| } = 0 \text{ .}
  \end{align*}
  Together with \eqref{eq bound opt stopp} this implies that $v^L$ is continuous w.r.t.\ $\mathcal A \mathcal W_p$.
\end{proof}

\begin{remark}
  The above proof reveals that if $L_t$ is Lipschitz with constant $c>0$ for every $t$, then $|v^L(\mu)-v^L(\nu)|\leq c\, \mathcal {SCW}_1(\mu,\nu)$.
\end{remark}

In order to show that the optimal stopping topology is finer than the $\mathcal W_p$-information topology, we need to make a few preparations.

\begin{lemma}\label{lemv con det 1}
  Let $\mathcal{A}$ be a Polish space.
  Then the family
  \begin{align}
  \label{eq:convergence.set.1}
  \set{ \Pr{\mathcal{A}} \ni \mu \mapsto G\left(\int_\mathcal{A} h_1 \d\mu,\dots,\int_\mathcal{A} h_L \d\mu \right ) :
  \begin{array}{l}
  L\in\mathbb N,G\in C_b(\mathbb R^L)\\
  (h_i)_{i\leq L}\subset C_b(\mathcal{A})
  \end{array}  }
  \end{align}
  is convergence determining for the weak topology on $\Pr{\Pr{\mathcal{A}}}$, that is, a sequence of probability measures $(\mu_n)_n$ in $\Pr{\Pr{\mathcal{A}}}$ converges weakly to a probability measure $\mu\in \Pr{\Pr{\mathcal{A}}}$ if and only if $\int F\d\mu_n\to\int F\d\mu$ for all $F$ in \eqref{eq:convergence.set.1}.
\end{lemma}

This follows from the Stone-Weierstrass theorem in case of compact $\mathcal{A}$ and readily extends to general Polish spaces e.g.\ via Stone-Čech compactification.

\begin{lemma}
\label{lemv con det 2}
  Let $\mathcal{A}$ be a Polish space.
  The family of functions
  \begin{align}
  \label{eq:convergence.set.2}
    \set{  \mu\mapsto G\left(\int_{\mathcal{A}} h \d\mu\right)\,:\,\, h\in C_b(\mathcal{A}),  G \in C_b(\mathbb{R})  }
  \end{align}
  is convergence determining for the weak topology on $\Pr{\Pr{\mathcal{A}}}$.
\end{lemma}
\begin{proof}
  Let $L$, $G$, and $(h_i)_{i\leq L}$ as in \eqref{eq:convergence.set.1}.
  Moreover, let $m\in\mathbb{R}$ such that $|h_i|\leq m$ for all $1\leq i\leq L$ and define $I:=[-m,m]^L$.
  Then $I\subset\mathbb{R}^L$ is compact and satisfies
  \[\left(\int h_1d\mu,\dots,\int h_L\d\mu\right)\in I\quad\text{for all }\mu\in \Pr{\mathcal{A}}.\]

  Let $\sigma\colon\mathbb{R}\to\mathbb{R}$ be some fixed bounded continuous sigmoid function such as $\sigma(r)=(1+e^{-r})^{-1}$ or $\sigma(r)=\max(0,\min(r,1))$.

  By the universal approximation result of Cybenko \cite[Theorem 2]{Cy89}, the set
  \[\set{ x\mapsto  \sum_{i=1}^m u_i \sigma(v_i\cdot x+w_i):
  \begin{array}{l}
  m\in\mathbb N,(u_i)_{i\leq m}\subset \mathbb{R},\\
  (v_i)_{i\leq m}\subset \mathbb{R}^L, (w_i)_{i\leq m}\subset \mathbb{R}
  \end{array} }\]
  is dense in $C(I,\mathbb{R})$ w.r.t.\ the supremum norm.
  As a result, it is enough to replace $G$ in \eqref{eq:convergence.set.1} by functions of the form $x\mapsto\sum_{i=1}^m u_i \sigma(v_i\cdot x+w_i)$.
  Evaluating the latter function on the vector $x=(\int h_1\d\mu,\dots,\int h_L\d\mu)$ yields
  \begin{align*}
  \sum_{i=1}^m u_i \sigma\left(\sum_{k=1}^L v_i^k\int h_k \d \mu + w_i\right)
  &=\sum_{i=1}^m u_i \sigma\left(\,\int \left (\sum_{k=1}^{L+1} v_i^k h_k \right ) \d \mu\,\right)\\
  &=\sum_{i=1}^m u_i\sigma\left( \int \bar h_i \d \mu \right),
  \end{align*}
  upon defining $v_i^{L+1}:=b_i$, $w_{L+1}:=1$, and finally $\bar h_i:= \sum_{k=1}^{L+1} v_i^k h_k$ for every $i$.
  The result follows from Lemma \ref{lemv con det 1}.
\end{proof}

\begin{lemma}
\label{lem:stopping.finer.than.information}
  The $\mathcal W_p$-optimal stopping topology is finer than the $\mathcal W_p$-information topology.
\end{lemma}
\begin{proof}
  The choice $L_T:=-\rho(x,x_0)^p-1$ and $L_t:=0$ for $t\neq T$ shows that convergence in the $\mathcal W_p$-optimal stopping topology implies convergence of the $p$-th moments.
  Thus, we are left to show that convergence in the optimal stopping topology implies convergence in Hellwig's information topology.
  Then, by the part of Lemma \ref{lem:convergence.moments} which has already been established, we obtain convergence in the $\mathcal W_p$-information topology.

  Fix $1\leq t\leq N-1$ and denote by $\mathcal{A}:=\overline{\mathcal{X}}^t$ the first $t$ and by $\mathcal{B}:=\overline{\mathcal{X}}_{t+1}$ the last $N-t$ coordinates.
  As $C_b(\mathcal{A})$ is convergence determining for $\Pr{\mathcal{A}}$, and $\{\nu\mapsto G (\int_{\mathcal{B}} h\d\nu):h\in C_b(\mathcal{B}), G \in C_b(\mathbb{R})\}$ is, by Lemma \ref{lemv con det 2}, convergence determining for $\Pr{\Pr{\mathcal{B}}}$, it follows e.g.\ from \cite[Proposition 4.6 (p.115)]{EtKu09} that
  \begin{align}
  \label{eq:convergence.set.3b}
  \set{ (a,\nu)\mapsto f(a)g\left(\int_\mathcal{B} h(b) \d\nu(b) \right) : f\in C_b(\mathcal{A}),\,g\in C_b(\mathbb R),\,h\in C_b(\mathcal{B}) },
  \end{align}
  is convergence determining for the weak topology on $\Pr{\mathcal{A}\times\Pr{\mathcal{B}}}$.
  Since $h$ in \eqref{eq:convergence.set.3b} is bounded, one can actually take $g$ in \eqref{eq:convergence.set.3b} to be compactly supported.
  But a continuous compactly supported function can be approximated uniformly by piecewise linear functions.
  The latter are linear combinations of functions of the form $z\mapsto\min(c,dz)$ where $c,d\in\mathbb{R}$.
  It therefore follows that
  \begin{align}
  \label{eq:convergence.set.4}
  \set{ (a,\nu) \mapsto \min\left( f(a)\,,\, \int_\mathcal{B} f(a)h(b) \d\nu(b) \right) : f\in C_b(\mathcal{A}), h\in C_b(\mathcal{B}) },
  \end{align}
  is also convergence determining for the weak topology on $\Pr{\mathcal{A}\times\Pr{\mathcal{B}}}$.
  Let $F$ be a function in \eqref{eq:convergence.set.4}, defined via $f\in C_b(\mathcal{A})$ and $h\in C_b(\mathcal{B})$, and let $m\in\mathbb{R}$ be a bound for $|f|$ and $|h|$.
  Define $L\in AC_p({\overline X})$ via
  \[L_t:=f\circ \overline{X}^t \quad L_T:=(f\circ \overline{X}^t)  \cdot (h\circ \overline{X}_{t+1}) \quad\text{and } L_s:=m+1\text{ for }s\neq t,T. \]
  (Where $\overline{X}^t$ is the projection onto the first $t$ coordinates and $\overline{X}_{t+1}$ is the projection onto the remaining $N-t$ coordinates.)

  By dynamic programming (the Snell-envelope theorem) one has
  \begin{align*}
    v^L(\mu)&= \E[\mu]{ \min\left( f(\overline{X}^t), \E[\mu]{ f(\overline{X}^t)h(\overline{X}_{t+1}) | \overline{X}^t }\right) }\\
    &=\int_{\mathcal{A}\times\Pr{\mathcal{B}}} F \d(\disint {\mathcal{A}} {\mathcal{B}}(\mu))
  \end{align*}
  for every $\mu\in\Pr{\mathcal{A}\times\mathcal{B}}$.
  This implies that the optimal stopping topology is finer than the initial topology of $\mu\mapsto \int F \d (\disint {\mathcal{A}} {\mathcal{B}}(\mu))$ over $F$ in \eqref{eq:convergence.set.4}.
  As \eqref{eq:convergence.set.4} is convergence determining for the weak topology on $\Pr{\mathcal{A}\times\Pr{\mathcal{B}}}$, the optimal stopping topology is indeed finer than the information topology, and as observed at the beginning of this proof therefore the $\mathcal W_p$-optimal stopping topology is finer than the $\mathcal W_p$-information topology.
\end{proof}

All Adapted Topologies are Equal