---
abstract: |
    This paper addresses risk awareness of stochastic optimization problems. Nested risk measures appear naturally in this context, as they allow beneficial reformulations for algorithmic treatments. The reformulations presented extend usual HamiltonJacobiBellman equations in dynamic optimization by involving risk awareness in the problem formulation.

    Nested risk measures are built on risk measures, which originate by conditioning on the history of a stochastic process. We derive martingale properties of these risk measures and use them to prove continuity. It is demonstrated that stochastic optimization problems, which incorporate risk awareness via nesting risk measures, are continuous with respect to the natural distance governing these optimization problems, the nested distance.

    **Keywords:** Risk measures, Stochastic optimization, Stochastic processes

    **Classification:** 90C15, 60B05, 62P05
author:
- 'Alois Pichler[^1]'
- 'Ruben Schlotter[^2]'
bibliography:
- '0\_HOME1\_users\_personal\_rubsc\_Dropbox\_LiteraturAlois2.bib'
title: '**Martingale Characterizations Of Risk-Averse Stochastic Optimization Problems**'
---

@path<span><span>/HOME1/users/personal/rubsc/Dropbox/</span></span>

\[sec:Introduction\]Introduction
================================

Risk measures have been found useful in various disciplines of applied mathematics, particularly in mathematical finance and in stochastic optimization. Many applications involve them in various places to account for risk. It is hence natural to investigate risk measures in a multistage or dynamic optimization framework as well. One of the first occurrences of dynamic risk measures in the literature is @Riedel2004, conditional risk measures are discussed in @Ruszczynski (consider also the references therein).

It seems that there is no general consensus on how to incorporate risk measures in a more general framework which involves time. One of the conceptual difficulties arising in a problem setting involving time is time consistency. In short, the decisions considered optimal at some stage of time should not be rejected from a later perspective.

Risk-averse multistage stochastic programs incorporate risk awareness in multistage decision making. These problems have been considered in @Ruszczynski2010 and @Dentcheva2017, while applications can be found in @PhilpottMatos [@PhilpottMatosFinardi] or @Maggioni2012, e.g., where stochastic dual dynamic programming methods are addressed, cf. also @Romisch [@Leclere2015]. In economics, the spread between *risk-averse* and *risk-neutral* preferences is associated with a risk or insurance premium. For this, the prevailing idea of risk in these papers is the interpretation as insurance on a rolling horizon basis.

This paper introduces conditional risk functionals based on the history of the governing stochastic process. These functionals are nested to obtain risk functionals accounting for the risk at each stage of the stochastic process. We elaborate their continuity properties and for important cases we compare them with simple risk measures spanning the entire horizon as a whole.

Building on the idea in @Pflug2009 we introduce the nested distance via conditional probabilities. We relate these concepts by verifying that nested risk functionals are continuous with respect to the nested distance and provide an explicit expression of the modulus of continuity.

Martingales are present in stochastic optimization since its very beginning, cf. @Rockafellar1976. The approach taken here to verify the results is based on generalized martingales. They reflect the evolution of risk over time, as risk measures replace risk-neutral expectations. It is demonstrated that the nested distance, as well as nested risk measures, follow martingale characteristics in this generalized sense.

It is a consequence that risk-averse multistage stochastic programs are continuous with respect to the nested distance. The optimal solutions constitute a stochastic process, which again follows a martingale-like pattern. We finally give a verification theorem. This is a risk-averse generalization of HamiltonJacobiBellman equations, which are well-known from dynamic optimization.

#### Outline of the paper.

Section \[sec:ConditionalRisk\] introduces nested risk functionals after an introductory discussion (Section \[sec:NestedDistance\]). Section \[sec:CostProcess\] addresses the main featurs of the nested distance which are important and relevant to cover the discussion on continuity of the multistage stochastic programs in Section \[sec:ContinuityRisk\]. Risk martingales are introduced in Section \[sec:Martingale\]. We conclude with the main result in Section \[sec:Continuity\].

\[sec:NestedDistance\]Notation and preliminaries
================================================

We consider the Polish spaces $\big(\Xi_{t},d_{t}\big)$, $t\in\left\{ 1,\dots,T\right\} $. We shall associate $t\in\left\{ 1,\dots,T\right\} $ with *stage* or *time* advancing in discrete steps from $1$ to $T$, where $T\in\left\{ 1,2,\dots\right\} $ is the time horizon (terminal time) or final stage. Each space $\Xi_{t}$, $t=1,\dots T$, contains the information revealed at time $t$. In what follows it will often be sufficient to consider the spaces $\Xi_{t}=\mathbb{R}^{m_{t}}$.

The product $\Xi:=\Xi_{1:T}:=\Xi_{1}\times\dots\times\Xi_{T}$ is endowed with the metric $d$ and $$\left(\Xi,\,d\right)\label{eq:2}$$ is Polish as well (for example, choose $d(x,y):=\ell_{p}(x,y):=\left(\sum_{t=1}^{T}d_{t}(x_{t},y_{t})^{p}\right)^{\nicefrac{1}{p}}$). We denote elements $x\in\Xi_{1:T}$ by $x_{1:T}:=x=(x_{1},\dots,x_{T})$ and by $\operatorname{\mathsf{pr}}_{t}$ the canonical (i.e., coordinate) projection $\operatorname{\mathsf{pr}}_{t}(x_{1:T}):=x_{1:t}$ onto the subspace $\Xi_{1:t}:=\Xi_{1}\times\dots\times\Xi_{t}$. To allow a compact notation we also introduce the empty tuple $x_{1:0}=()$.

On the Borel sets $\mathcal{F}_{T}:=\mathscr{B}(\Xi_{1:T})$ we consider the probability measure $$P\colon\mathcal{F}_{T}\to[0,1].$$ The probability measures restricted to the sub-sigma algebra $\mathcal{F}_{t}:=\sigma(\operatorname{\mathsf{pr}}_{t})$ are the image measures defined by $$P_{t}(A):=P^{\operatorname{\mathsf{pr}}_{t}}(A)=P\left(A\times\Xi_{t+1}\times\dots\times\Xi_{T}\right),$$ where $A\in\mathscr{B}(\Xi_{1:t})$, the Borel sigma algebra on $\Xi_{1:t}$. The sequence $\mathcal{F}:=\mathcal{F}_{0:T}:=\left(\mathcal{F}_{t}\right)_{t=0}^{T}$ is the canonical (i.e., coordinate) filtration and $(\Xi_{1:T},\mathcal{F}_{0:T},P)$ is a filtered probability space (a.k.a. stochastic basis), where we include the trivial sigma algebra $\mathcal{F}_{0}:=\left\{ \emptyset,\,\Xi_{1:T}\right\} $ for completeness and convenience.

The disintegration theorem (cf. @Dellacherie1978 [III-70] or @Ambrosi2005 [Section 5.3]) allows 'disintegrating' \[disintegration\] the probability measure with respect to the coordinates.

\[Disintegration theorem\] \[thm:Disintegrate\]There is a regular kernel, i.e., a $P_{t}$-a.s. uniquely defined family of measures $P\left(\cdot|\,x_{1:t}\right)$ so that

1.  \[enu:Disintegrate1\]$x_{1:t}\mapsto P\left(B\mid x_{1:t}\right)$ is measurable for every $B\in\mathscr{B}(\Xi_{t+1}\times\dots\times\Xi_{T})$ and

2.  $P(A\times B)=\int_{A}P\left(B\mid x_{1:t}\right)P_{t}(\mathrm{d}x_{1:t})$, where $A\in\mathscr{B}(\Xi_{1}\times\dots\times\Xi_{t})$ and $B\in\mathscr{B}(\Xi_{t+1}\times\dots\times\Xi_{T})$.

The conditional probability measures $$P_{t+1}(\cdot\mid x_{1:t})\;\text{ on }\;\mathscr{B}(\Xi_{t+1})\label{eq:kernel}$$ are called (regular) *kernels* and the substring $x_{1:t}$ is also called a *fiber*.

By disintegrating the measures $P_{t}$ and composing their kernels at subsequent stages we obtain the nested expressions $$P_{t}(A_{1}\times\dots\times A_{t})=\int_{A_{1}}\int_{A_{2}}\dots\int_{A_{t}}P_{t}\left(\mathrm{d}x_{t}|\,x_{1:t-1}\right)\dots P_{2}\left(\mathrm{d}x_{2}|\,x_{1:1}\right)P_{1}(\mathrm{d}x_{1})\label{eq:4}$$ and the conditional probability measures $$P(A_{t+1}\times\dots\times A_{T}\mid x_{1:t})=\int_{A_{t+1}}\dots\int_{A_{T}}P_{T}\left(\mathrm{d}x_{T}|\,x_{1:T-1}\right)\dots P_{t+1}\left(\mathrm{d}x_{t+1}|\,x_{1:t}\right).\label{eq:5}$$ Both expressions reveal the initial probability measure $P$, which can be seen by substituting $t=T$ in  or $t=0$ in .

The kernels derived from the projected measures  are conditioned on the history $x_{1:t}$ and they do depend explicitly on the entire history up to $t$. In the Markovian case this dependence reduces (simplifies) to $$P_{t+1}(\cdot\mid x_{1:t})=P_{t+1}(\cdot\mid x_{t}).$$

An important algorithm in stochastic optimization is Stochastic Dual Dynamic Programming (SDDP). In this context the probabilities are typically assumed to be *stagewise independent,* i.e., $$P_{t+1}(\cdot\mid x_{1:t})=P_{t+1}(\cdot)$$ (cf. @FilipeGoulart2017).

\[sec:ConditionalRisk\]Conditional and nested risk measures
===========================================================

To define conditional risk functionals we recall the definition of *law invariant, coherent risk functionals* $\mathcal{R}\colon L\to\mathbb{R}$ defined on some vector space $L$ of $\mathbb{R}$-valued random variables first. They satisfy the following axioms introduced by @Artzner1997.

1.  \[enu:Monotonicity\]Monotonicity: $\mathcal{R}\left(Y_{0}\right)\le\mathcal{R}\left(Y_{1}\right)$, provided that $Y_{0}\le Y_{1}$ almost surely;

2.  Translation equivariance: $\mathcal{R}\left(Y+c\right)=\mathcal{R}\left(Y\right)+c$ for $c\in\mathbb{R}$;

3.  \[enu:Convexity\] Convexity: $\mathcal{R}\big((1-\lambda)Y_{0}+\lambda Y_{1}\big)\le(1-\lambda)\mathcal{R}\left(Y_{0}\right)+\lambda\mathcal{R}\left(Y_{0}\right)$;

4.  \[enu:Homogeneous\]Positively homogeneity: $\mathcal{R}\left(\lambda Y\right)=\lambda\mathcal{R}\left(Y\right)$;

<!-- -->

1.  \[enu:LawInvariance\]Law invariance: $\mathcal{R}(Y)=\mathcal{R}(Y^{\prime})$, whenever $Y$ and $Y^{\prime}$ have the same law, i.e., $P(Y\le y)=P(Y^{\prime}\le y)$ for all $y\in\mathbb{R}$.

We shall make frequently use of the following proposition, which is an immediate consequence of the monotonicity axiom \[enu:Monotonicity\].

\[rem:infimum\]The essential infimum of a set of random variables apparently satisfies $\operatorname*{ess\,inf}_{\iota^{\prime}\in I}Y_{\iota^{\prime}}\le Y_{\iota}$ for every $\iota\in I$. Hence, by the monotonicity axiom, \[enu:Monotonicity\], $\mathcal{R}\left(\operatorname*{ess\,inf}_{\iota^{\prime}\in I}Y_{\iota^{\prime}}\right)\le\mathcal{R}\left(Y_{\iota}\right)$ and subsequently $$\mathcal{R}\left(\operatorname*{ess\,inf}_{\iota^{\prime}\in I}Y_{\iota^{\prime}}\right)\le\inf_{\iota\in I}\mathcal{R}\left(Y_{\iota}\right).$$

The Average Value-at-Risk at level $\alpha\in[0,1)$ defined on $L^{1}(P)$ by $$\operatorname{\mathsf{AV@R}}_{\alpha}(Y):=\inf_{q\in\mathbb{R}}\left\{ q+\frac{1}{1-\alpha}\operatorname{{\mathds E}}(Y-q)_{+}\right\} \label{eq:15-1}$$ is the most prominent coherent risk functional satisfying the axioms \[enu:Monotonicity\]\[enu:LawInvariance\] above. The Average Value-at-Risk at risk level $\alpha=0$ is the expectation, $$\operatorname{\mathsf{AV@R}}_{0}(Y)=\operatorname{{\mathds E}}Y$$ and, for $Y\in L^{\infty}$, the convenient setting $$\operatorname{\mathsf{AV@R}}_{1}(Y):=\lim_{\alpha\nearrow1}\operatorname{\mathsf{AV@R}}_{\alpha}(Y)=\operatorname*{ess\,sup}Y$$ continuously extends the Average Value-at-Risk to $\alpha=1$.

The Average Value-at-Risk turns out to be of central importance, it can be interpreted as an extreme point in the set of risk functionals and, similarly to Choquet's representation, every risk functional is a convex combination of $\operatorname{\mathsf{AV@R}}$s. The following general representation (Kusuoka's representation, cf. @Kusuoka) highlights this relation. The statement is a consequence of the FenchelMoreau theorem in convex analysis (cf. @Follmer2004 [Lemma 4.55] or @RuszczynskiShapiro2009 [@Shapiro2011; @ShapiroAlois]).

A function $\sigma\colon[0,1)\to\mathbb{R}$ is a *distortion function*, if $\sigma(\cdot)$ is non-decreasing, $\sigma(\cdot)\ge0$ and $\int_{0}^{1}\sigma(u)\mathrm{d}u=1$.

\[Derived from Kusuoka's representation, cf. @PflugPichlerBuch\] \[prop:Kusuoka\]Every law invariant, coherent risk functional $\mathcal{R}\colon L\to\mathbb{R}$ has the representation $$\mathcal{R}(Y)=\sup_{\sigma\in\mathcal{S}}\mathcal{R}_{\sigma}(Y),\label{eq:Rsigma}$$ where $\mathcal{S}$ is an appropriate collection of distortion functions and $$\mathcal{R}_{\sigma}(Y):=\sup\begin{Bmatrix}\operatorname{{\mathds E}}Y\zeta\,\left|\begin{array}{l}
\zeta\ge0,\,\operatorname{{\mathds E}}\zeta=1\text{ and}\\
\operatorname{\mathsf{AV@R}}_{\alpha}(\zeta)\le\frac{1}{1-\alpha}\int_{\alpha}^{1}\sigma(u)\mathrm{d}u\text{ for all }\alpha\in(0,1)
\end{array}\right.\end{Bmatrix}.\label{eq:RDual}$$ The vector space $L$ can be assumed to be $L=\left\{ Y\colon\mathcal{R}_{\sigma}(\left|Y\right|)<\infty\right\} $ (cf. @Pichler2013a). In applications, as well in what follows it will be enough to consider the Lebesgue spaces $L^{p}$, $p\ge1$, or $L^{\infty}$.

The representation of the distortion risk functional  implicitly involves the probability measure $P$ via the expectation $\operatorname{{\mathds E}}$ and the Average Value-at-Risk in . We want to make the probability measure $P$ explicit by rewriting  as $$\mathcal{R}(Y)=\mathcal{R}_{\mathcal{S};P}(Y):=\sup\begin{Bmatrix}\operatorname{{\mathds E}}_{P}Y\zeta\,\left|\begin{array}{l}
\zeta\ge0,\,\operatorname{{\mathds E}}_{P}\zeta=1\text{ and}\\
\operatorname{\mathsf{AV@R}}_{\alpha;P}(\zeta)\le\frac{1}{1-\alpha}\int_{\alpha}^{1}\sigma(u)\mathrm{d}u,\,\alpha\in(0,1)\\
\qquad\text{ for some }\sigma(\cdot)\in\mathcal{S}
\end{array}\right.\end{Bmatrix},\label{eq:Risk}$$ where the expectation in $\operatorname{\mathsf{AV@R}}_{\alpha;P}$ is with respect to the probability measure $P$ as well, cf. .

\[exa:AVaR\]The Kusuoka representation of the Average Value-at-Risk according to Proposition \[prop:Kusuoka\] is given by $\mathcal{S}=\left\{ \sigma_{\alpha}(\cdot)\right\} $, where the distortion function is $\sigma_{\alpha}(u):=\begin{cases}
\frac{1}{1-\alpha} & \text{if }u\ge\alpha,\\
0 & \text{else}.
\end{cases}$

Conditional risk measures
-------------------------

To define conditional versions of risk measures on product spaces we employ the conditional measures available by the disintegration theorem, Theorem \[thm:Disintegrate\].

Let $\mathcal{S}_{t+1}$ be a collection of distortion functions. The *conditional risk measure* or risk *measure conditioned on the fiber $x_{1:t}$* of the regular kernels of the probability measure $P$ is $$\mathcal{R}_{\mathcal{S}_{t+1}}(Y\mid x_{1:t}):=\sup_{\sigma\in\mathcal{S}_{t+1}}\mathcal{R}_{\sigma;P(\cdot\mid x_{1:t})}(Y).\label{eq:16-2}$$

As a consequence of Theorem \[thm:Disintegrate\]\[enu:Disintegrate1\] and the representations  and , the mapping $$\begin{aligned}
\mathcal{R}_{\mathcal{S}_{t+1}}(Y\mid\cdot)\colon\Xi_{1:t} & \to\mathbb{R}\nonumber \\
x_{1:t} & \mapsto\mathcal{R}_{\mathcal{S}_{t+1}}(Y\mid x_{1:t})\label{eq:10}\end{aligned}$$ is a random variable on $\Xi_{1:t}$, which is $P_{t}$ a.s. well-defined and measurable with respect to $\mathcal{F}_{t}$. For $t=0$, the conditional risk functional  is $$\mathcal{R}_{\mathcal{S}_{1}}(Y\mid x_{1:0})=\mathcal{R}_{\mathcal{S}_{1}}(Y)=\sup_{\sigma\in\mathcal{S}_{1}}\mathcal{R}_{\sigma;P}(Y)=\mathcal{R}_{\mathcal{S}_{1}}(Y),$$ a deterministic number.

Nested risk measures
--------------------

The conditional risk measures  are well-defined on a fiber $x_{1:t}$. As each risk functinoal  is a random variable, they can be combined and considered in the following recursive, or nested way.

\[Nested risk functional\] \[def:NestedRisk\]Let $s,\,t\in\left\{ 1,\dots,T\right\} $ with $s<t$. The *nested risk functional* for a sequence $\mathcal{S}_{s+1:t}:=\mathcal{S}_{s+1}\times\dots\times\mathcal{S}_{t}$ of collections of distortion functionals is $$\mathcal{R}_{\mathcal{S}_{s+1:t}}(Y\mid x_{1:s}):=\mathcal{R}_{\mathcal{S}_{s+1}}\Bigl(\dots\mathcal{R}_{\mathcal{S}_{t-1}}\bigl(\mathcal{R}_{\mathcal{S}_{t}}(Y\mid x_{1:t-1})\mid x_{1:t-2}\bigr)\dots\mid x_{1:s}\bigr)\Bigr).\label{eq:5-1}$$

The nested risk functional $\mathcal{R}_{\mathcal{S}_{1:T}}(\cdot)$ maps real-valued random variables $Y\colon\Xi\to\mathbb{R}$ defined on $\Xi$ to the real line. The nested risk functional satisfies generalizations of the axioms \[enu:Monotonicity\]\[enu:Homogeneous\], but it is *not* law invariant any longer, i.e., \[enu:LawInvariance\] is not necessarily satisfied.

The construction employed in @Shapiro2015 to discuss rectangular sets is similar to nested risk measure given in Definition \[def:NestedRisk\] above. Indeed, they can be recovered by choosing the feasible set as given in the general representation . A major difference is given by the fact that law invariant risk functionals have the Kusuoka representation , which is not the case for more general risk functionals.

Importantly, the nested risk measures are recursive as specified in the following proposition.

The nested risk functional $\mathcal{R}_{\mathcal{S}_{t+1:T}}$ is recursive, it holds that $$\mathcal{R}_{\mathcal{S}_{t+1:T}}(Y\mid x_{1:t})=\mathcal{R}_{\mathcal{S}_{t+1:s}}\left(\mathcal{R}_{\mathcal{S}_{s+1:T}}(Y\mid x_{1:s})\mid x_{1:t}\right)\label{eq:recursive}$$ whenever $0\le t<s<T$.

The assertion is an immediate consequence of the recursion  in Definition \[def:NestedRisk\].

\[Conditional expectation\] The risk-neutral special case is given by choosing the simplest distortion functions $\mathcal{S}_{t+1}=\left\{ \operatorname{{\mathds 1}}\right\} $, i.e., the distortions consisting only of the constant function $\sigma(\cdot)=\operatorname{{\mathds 1}}(\cdot)=1$. In this case the risk functional  is $$\mathcal{R}_{\mathcal{S}_{t+1};P}(Y\mid x_{1:t})=\operatorname{{\mathds E}}\left(Y\mid x_{1:t}\right),$$ i.e., $$\mathcal{R}_{\mathcal{S}_{t+1};P}(Y\mid\cdot)=\operatorname{{\mathds E}}^{\mid\mathcal{F}_{t}}(Y)$$ (recall that $\operatorname{{\mathds E}}^{\mid\mathcal{F}_{t}}(Y)$ is indeed an $\mathcal{F}_{t}$ random variable). The recursion  reflects the tower property of the conditional expectation.

\[Nested Average Value-at-Risk, cf. @PflugRomisch2007\] The nested Average Value-at-Risk for $\alpha_{s+1:t}\in[0,1]^{t-s}$ is a composition of $\operatorname{\mathsf{AV@R}}$s at risk levels dependent on the state $t$. More explicitly, we set $$\operatorname{\mathsf{nAV@R}}_{\alpha_{s+1:t}}(Y\mid x_{1:s}):=\operatorname{\mathsf{AV@R}}_{\alpha_{s+1};P(\cdot|x_{1:s})}\Bigl(\dots\,\operatorname{\mathsf{AV@R}}_{\alpha_{t-1};P(\cdot|x_{1:t-2})}\bigl(\operatorname{\mathsf{AV@R}}_{\alpha_{t};P(\cdot|x_{1:t-1})}(Y)\bigr)\bigr)\Bigr).\label{eq:nAVaR}$$

The nested Average Value-at-Risk can be bounded by the Average Value-at-Risk. Indeed, it follows from @ShapiroXin [Proposition 4.2] that $\operatorname{\mathsf{nAV@R}}_{\alpha_{1:T};P}(Y)\le\operatorname{\mathsf{AV@R}}_{\alpha}(Y)$ provided that the risk level $\alpha$ satisfies $\alpha\ge1-(1-\alpha_{1})\dots(1-\alpha_{T})$.

\[sec:CostProcess\]The distance adapted to nested risk measures 
================================================================

Generalizing the concept of distance from probability spaces to filtered probability spaces corresponds to generalizing the distance from random variables to stochastic processes. As a metric for probability measures we recall the Wasserstein distance first here, which we then generalize to a metric of stochastic processes.

Wasserstein metric
------------------

Consider the Polish space $(\Xi,d)$ and probability measures $$P,\,\tilde{P}\colon\mathcal{F}\to[0,1]$$ on the Borel sigma algebra $\mathcal{F}:=\mathscr{B}(\Xi)$.

\[Wasserstein metric\] \[def:Wasserstein\]Let $P$ and $\tilde{P}$ be probability measures on $\Xi$ and $r\in[1,\infty)$. The *Wasserstein metric of order $r$* with respect to the cost function $c\colon\Xi\times\Xi\to\mathbb{R}$ is $$w_{r}(P,\tilde{P};\,c):=\inf_{\pi}\left(\operatorname{{\mathds E}}_{\pi}c^{r}\right)^{\nicefrac{1}{r}}=\inf_{\pi}\left(\iint_{\Xi\times\Xi}c(x,y)^{r}\,\pi(\mathrm{d}x,\mathrm{d}y)\right)^{\nicefrac{1}{r}},\label{eq:1}$$ where the infimum in  is among all bivariate probability measures $\pi\in\mathcal{P}(\Xi\times\Xi)$ with marginals $P$ and $\tilde{P}$, i.e., $$\begin{aligned}
\pi(A\times\Xi) & =P(A),\quad A\in\mathscr{B}(\Xi)\quad\text{ and}\label{eq:11}\\
\pi(\Xi\times B) & =\tilde{P}(B),\quad B\in\mathscr{B}(\Xi).\label{eq:12}\end{aligned}$$ For the Wasserstein distance of order $r=1$ we shall also write simply $w(P,\tilde{P})$.

\[rem:Wasserstein\]The Wasserstein metric introduced in  is based on a cost functions $c(\cdot)$ (cf. also @Villani2003). This setting slightly generalizes the usual definition, which is based on the distance function $d$ of the space $(\Xi,d)$ in lieu of $c$. In what follows, this extension will be essential.

The nested distance
-------------------

The Wasserstein metric $w_{r}$ introduced in Definition \[def:Wasserstein\] is of course well defined for measures $P$ and $\tilde{P}$ on the product space $\left(\Xi_{1:T},d\right)$. The nested distance generalizes the Wasserstein metric by involving the filtration in addition. The filtration carries the information revealed over time. The filtration considered here is the coordinate filtration, and for this we may introduce the nested distance on coordinate basis as well, i.e., sequentially by defining the process stage by stage.

\[Cost process, nested distance\] \[def:Nested\]Let $P$ and $\tilde{P}$ be probability measures on $\Xi_{1:T}$, let $r\in[1,\infty)$ and let $c\colon\Xi_{1:T}\times\Xi_{1:T}\to\mathbb{R}$ be a lower semi-continuous (lsc.) function.

1.  Cost process $c_{t}$ for $t=T$ down to $0$:

    1.  The cost function $c_{T}$ on $\Xi_{1:T}\times\Xi_{1:T}$ at terminal time $T$ is $$\begin{aligned}
        c_{T}\big(x_{1:T},y_{1:T} & \big):=c\big(x_{1:T},y_{1:T}\big).\end{aligned}$$ We shall refer to $c_{T}$ also as the *terminal* cost function.

    2.  The cost functions $c_{t}$ for $t<T$ are defined in a backwards recursive way by $$c_{t-1}\big(x_{1:T},y_{1:T}\big):=w_{r}\left(P_{t}\left(\cdot\mid x_{1:t-1}\right),\,\tilde{P}_{t}\left(\cdot\mid y_{1:t-1}\right);\,c_{t}\right),\quad t=T,\dots,1,\label{eq:3}$$ where $w_{r}$ is the Wasserstein metric of order $r$.

    3.  The *cost-process* is the stochastic process $c=\left(c_{t}\right)_{t=0}^{T}$.

2.  The nested distance: let $c=\left(c_{t}\right)_{t=0}^{T}$ be the cost process with terminal cost $$c_{T}(\cdot)=d(\cdot),\label{eq:Dist}$$ the distance of the space $\Xi_{1:T}$ (cf. ). The *nested distance* of order $r\ge1$ of the measures $P$ and $\tilde{P}$ is $$\operatorname{\mathsf{d\kern-.15ex I}}_{r}\bigl(P,\tilde{P}\bigr):=c_{0}.\label{eq:8}$$

The function $c_{t}$ is defined for $\left(x_{1:T},y_{1:T}\right)\in\Xi_{1:T}\times\Xi_{1:T}$, but its definition in  notably involves only the truncated states $\left(x_{1:t},y_{1:t}\right)\in\Xi_{1:t}\times\Xi_{1:t}$. The cost function $c_{t}$ thus is unambiguously defined for $\left(x_{1:t},y_{1:t}\right)$, irrespective of future realization $\left(x_{t+1:T},y_{t+1:T}\right)$. It follows that $c_{t}$ is $\mathcal{F}_{t}\otimes\mathcal{F}_{t}$ measurable and the cost process $(c_{t})_{t=0}^{T}$ is adapted to the filtration $\mathcal{F}\otimes\mathcal{F}$.

In particular, $c_{0}$ is independent of the formal argument $\left(x_{1:T},y_{1:T}\right)$ (the string $x_{1:0}$ is empty for $t=0$ in ) so that $c_{0}$ is a number ($c_{0}=\operatorname{\mathsf{d\kern-.15ex I}}_{r}\bigl(P,\tilde{P}\bigr)\in\mathbb{R}$) and the nested distance is well-defined by .

It is a consequence of Hölder's inequality that $w_{r}\bigl(P,\tilde{P}\bigr)\le w_{r^{\prime}}\bigl(P,\tilde{P}\bigr)$ whenever $r\le r^{\prime}$. By monotonicity of  we thus get that $$\operatorname{\mathsf{d\kern-.15ex I}}_{r}\bigl(P,\tilde{P}\bigr)\le\operatorname{\mathsf{d\kern-.15ex I}}_{r^{\prime}}\bigl(P,\tilde{P}\bigr)\qquad(r\le r^{\prime}).\label{eq:5-2}$$

\[Relation to Wasserstein metric\] For $T=1$ we have $\Xi_{1:T}=\Xi_{1}$ and there are no intermediary stages present. In this case, the nested distance reduces to the usual Wasserstein metric and it holds that $$\operatorname{\mathsf{d\kern-.15ex I}}_{r}\bigl(P,\tilde{P}\bigr)=w_{r}\bigl(P,\tilde{P};\,d\bigr)\qquad(T=1).$$

As for the Wasserstein distance we also write $\operatorname{\mathsf{d\kern-.15ex I}}(P,\tilde{P})$ if the order is $r=1$ (cf. Remark \[rem:Wasserstein\]).

An important case in practice is the cost functions, where costs occur sequentially at every stage and total costs are accumulated over time. The cost process reflects this additive property, as the following proposition outlines.

\[Additive cost functions\] \[prop:Additive\]Suppose the terminal cost function is of particular form $$c_{T}(x,y)=\ell_{r}(x,y)=\left(\sum_{t=1}^{T}d_{t}(x_{t},y_{t})^{r}\right)^{\nicefrac{1}{r}},\label{eq:lr}$$ where $d_{t}$, $t=1,\dots,T$ are functions on $\Xi_{t}\times\Xi_{t}$ (distance functions, e.g.). Then the process $$\tilde{c}_{t}:=\left(c_{t}^{r}-\sum_{j=1}^{t-1}d_{j}^{r}\right)^{\nicefrac{1}{r}}\label{eq:Pflug}$$ satisfies the recursive equations $$\tilde{c}_{t-1}^{r}=d_{t-1}^{r}+w_{r}\left(P_{t}\left(\cdot\mid x_{1:t-1}\right),\,\tilde{P}_{t}\left(\cdot\mid y_{1:t-1}\right);\,\tilde{c}_{t}\right)^{r}\label{eq:9-1}$$ with $\tilde{c}_{T}=d_{T}$.

Further, the nested distance is $$\operatorname{\mathsf{d\kern-.15ex I}}_{r}\bigl(P,\tilde{P}\bigr)=\tilde{c}_{0}.$$

The recursive equation  is actually the initial attempt in defining a distance on the nested spaces $\Xi_{t}\times\mathcal{P}(\Xi_{t-1})$ for the particular case $r=1$, where $\mathcal{P}(\Xi_{t-1})$ is the set of probability measures on $\Xi_{t-1}$. We refer to @Pflug2009 for the initial and complete discussion on nested spaces and nested distances.

From  we have that $$c_{t-1}\left(x_{1:T},y_{1:T}\right)^{r}=w_{r}\left(P_{t}\left(\cdot\mid x_{1:t-1}\right),\,\tilde{P}_{t}\left(\cdot\mid y_{1:t-1}\right);\,c_{t}\right)^{r}.$$ As $d_{j}$ are $\mathcal{F}_{t-1}$-measurable for for every $j<t$ it follows further that $$c_{t-1}\left(x_{1:T},y_{1:T}\right)^{r}=\sum_{j=1}^{t-1}d_{j}^{r}+w_{r}\left(P_{t}\left(\cdot\mid x_{1:t-1}\right),\,\tilde{P}_{t}\left(\cdot\mid y_{1:t-1}\right);\,\left(c_{t}^{r}-\sum_{j=1}^{t-1}d_{j}^{r}\right)^{\nicefrac{1}{r}}\right)^{r}$$ and hence $$\begin{aligned}
\tilde{c}_{t-1}^{r}\left(x_{1:T},y_{1:T}\right)^{r} & =c_{t-1}\left(x_{1:T},y_{1:T}\right)^{r}-\sum_{j=1}^{t-2}d_{j}^{r}\\
 & =d_{t-1}^{r}+w_{r}\left(P_{t}\left(\cdot\mid x_{1:t-1}\right),\,\tilde{P}_{t}\left(\cdot\mid y_{1:t-1}\right);\,\left(c_{t}^{r}-\sum_{j=1}^{t-1}d_{j}^{r}\right)^{\nicefrac{1}{r}}\right)^{r}\\
 & =d_{t-1}^{r}+w_{r}\left(P_{t}\left(\cdot\mid x_{1:t-1}\right),\,\tilde{P}_{t}\left(\cdot\mid y_{1:t-1}\right);\,\tilde{c}_{t}\right)^{r},\end{aligned}$$ which is the assertion.

It is evident that the assertion of the previous statement holds as well in case of cost functions which are nonanticipative and of the form $c_{T}(x,y)=\left(\sum_{t=1}^{T}d_{t}(x_{1:t},y_{1:t})^{r}\right)^{\nicefrac{1}{r}}$.

Characterization as a martingale\[subsec:Martingale\]
-----------------------------------------------------

For the measure $P$ we have given the nested expressions  and  based on kernels explicitly. In the same way one may glue together the kernels which are optimal in  to compute the nested distance and cost process. To this end denote the optimal kernels on $\Xi_{t}\times\Xi_{t}$ obtained in  by $\pi_{t}(\cdot\times\cdot\mid x_{1:t},y_{1:t})$. A well-known result of @Brenier1987 [@Brenier1991] (see also @McCann) asserts that the Wasserstein problem  attains the infimum at a unique bivariate measure $\pi$ for the quadratic cost function $c(x,y)=\left\Vert x-y\right\Vert ^{2}$, if both measures $P$ and $\tilde{P}$ have finite variance and do not give mass to small sets (cf. @Villani2003 [Theorem 2.12]); the measures $\pi_{t}(\cdot\times\cdot\mid x_{1:t},y_{1:t})$ thus exist.

The global measure governing all kernels then is $$\begin{aligned}
\pi\left(A\times B\right): & =\iint_{A_{1}\times B_{1}}\Big(\iint_{A_{2}\times B_{2}}\dots\big(\iint_{A_{T}\times B_{T}}\pi_{T}(\mathrm{d}x_{T},\mathrm{d}y_{T}\mid x_{1:T-1},y_{1:T-1})\big)\label{eq:9}\\
 & \qquad\qquad\qquad\qquad\dots\pi_{2}(\mathrm{d}x_{2},\mathrm{d}y_{2}|\,x_{1},y_{1})\Big)\pi_{1}(\mathrm{d}x_{1},\mathrm{d}y_{1}),\nonumber \end{aligned}$$ where $A=A_{1}\times\dots\times A_{T}$ and $B=B_{1}\times\dots\times B_{T}$. The measure $\pi$ is a bivariate measure on the entire space $\Xi_{1:T}\times\Xi_{1:T}$.

We have the following alternative characterization of the governing bivariate measure .

The conditional marginals of the measure $\pi$ defined in  satisfy $$\begin{aligned}
\pi\left(A\times\Xi\mid x_{1:t},y_{1:t}\right) & =P\left(A\mid x_{1:t}\right),\qquad A\in\mathcal{F}_{T}\quad\text{ and}\label{eq:44}\\
\pi\left(\Xi\times B\mid x_{1:t},y_{1:t}\right) & =\tilde{P}\left(B\mid y_{1:t}\right),\qquad B\in\mathcal{F}_{T},\label{eq:45}\end{aligned}$$ for every $t\in\left\{ 0,\dots T-1\right\} $.

The most inner integral in  satisfies $$\iint_{A_{T}\times\Xi_{T}}\pi(\mathrm{d}x_{T},\mathrm{d}y_{T}|\,x_{1:T-1},y_{1:T-1})=\pi(A_{T}\times\Xi_{T}|\,x_{1:T-1},y_{1:T-1})=P(A_{T}|\,x_{1:T-1})$$ by construction of the measure $\pi(\cdot,\cdot|\,x_{1:T-1},y_{1:T-1})$. This is  for the terminal time $t=T-1$.

Suppose now, by backwards inductions, that the marginal  is valid for $t+1$. Then $$\begin{aligned}
\pi & \left(A_{t+1:T}\times\Xi_{t+1:T}|\,x_{1:t},y_{1:t}\right)\\
 & =\iint_{A_{t+1}\times\Xi_{t+1}}\dots\iint_{A_{T}\times\Xi_{T}}\pi(\mathrm{d}x_{T},\mathrm{d}y_{T}|\,x_{1:T-1},y_{1:T-1})\dots\pi(\mathrm{d}x_{t+1},\mathrm{d}y_{t+1}|\,x_{1:t},y_{1:t})\\
 & =\iint_{A_{t+1}\times\Xi_{t+1}}\pi(A_{t+2:T}\times\Xi_{t+2:T}|\,x_{1:t+1},y_{1:t+1})\pi(\mathrm{d}x_{t+1},\mathrm{d}y_{t+1}|\,x_{1:t},y_{1:t})\\
 & =\iint_{A_{t+1}\times\Xi_{t+1}}P(A_{t+2:T}|\,x_{1:t+1})\pi(\mathrm{d}x_{t+1},\mathrm{d}y_{t+1}|\,x_{1:t},y_{1:t})\\
 & =\int_{A_{t+1}}P(A_{t+2:T}|\,x_{1:t+1})P(\mathrm{d}x_{t+1}|\,x_{1:t})\\
 & =P(A_{t+1:T}|\,x_{1:t}),\end{aligned}$$ where we have used the decomposition , the induction hypothesis, the decomposition  and the setting $A_{t+1:T}:=A_{t+1}\times A_{t+2:T}$, . We conclude that identity  is valid for all $t$.

The remaining identity  follows analogously.

The process $(c_{t})_{t=0}^{T}$ given in Definition \[def:Nested\] is constructed by recursively averaging with respect to the conditional measures of $\pi$ given in . We thus have the following characterization as a martingale.

\[Martingale characterization\] \[thm:Martingale\]Let $\pi(\cdot,\cdot)$ be the measure defined in  and $r\ge1$. Then the cost process $c=(c_{t}^{r})_{t=1}^{T}$ is a martingale with respect to $\pi$ and the canonical filtration, i.e., $$c_{t}^{r}=\operatorname{{\mathds E}}_{\pi}\left(c_{t+1}^{r}\mid\mathcal{F}_{t}\otimes\mathcal{F}_{t}\right).$$

By definition of the process $c_{t}$ in  we have that $$c_{t-1}(x_{1:T},y_{1:T})^{r}=\iint_{\Xi_{t}\times\Xi_{t}}c_{t}(x_{1:T},y_{1:T})^{r}\pi(\mathrm{d}x_{t},\mathrm{d}y_{t}\mid x_{1:t-1},y_{1:t-1}),$$ where $\pi(\cdot,\cdot\mid x_{1:t-1},y_{1:t-1})$ is the measure with marginals $P(\cdot\mid x_{1:t-1})$ and $\tilde{P}(\cdot\mid y_{1:t-1})$, resp., for which the Wasserstein distance attains the infimum in . This is the conditional martingale property for the fibers $(x_{1:t-1},y_{1:t-1})$. The assertion follows as the measure $\pi$ in  combines these optimal, conditional measures.

\[Alternative characterization\] The nested distance is given by $$\operatorname{\mathsf{d\kern-.15ex I}}_{r}\bigl(P,\tilde{P}\bigr)=\inf_{\pi}\left(\operatorname{{\mathds E}}_{\pi}d^{r}\right)^{\nicefrac{1}{r}}=\inf_{\pi}\left(\iint_{\Xi\times\Xi}d(x,y)^{r}\pi(\mathrm{d}x,\mathrm{d}y)\right)^{\nicefrac{1}{r}},$$ where the infimum is among all probability measures $\pi\in\mathcal{P}(\Xi\times\Xi)$ satisfying the conditional marginal constraints . The infimum is attained for the measure $\pi$ defined in .

Let $\pi(\cdot\mid\cdot)$ satisfy the marginals . Then every conditional measure $\pi(\cdot,\cdot\mid x_{1:t-1},y_{1:t-1})$ satisfies the constraints  to compute the Wasserstein distance. It follows that $\operatorname{\mathsf{d\kern-.15ex I}}_{r}(P,\tilde{P})^{r}\le\operatorname{{\mathds E}}_{\pi}d^{r}$.

The measure $\pi$ defined in  satisfies the constraints  as well. However, we have from Theorem \[thm:Martingale\] that $c_{t}^{r}$ is a martingale. The assertion follows from the power property of the conditional expectation, as $c_{T}^{r}=d^{r}$ and $$\begin{aligned}
\operatorname{\mathsf{d\kern-.15ex I}}_{r}(P,\tilde{P})^{r}=c_{0}^{r} & =\operatorname{{\mathds E}}_{\pi}\left(\dots\operatorname{{\mathds E}}_{\pi}\left(c_{t+1}^{r}\mid\mathcal{F}_{t}\otimes\mathcal{F}_{t}\right)\dots\mid\mathcal{F}_{1}\otimes\mathcal{F}_{1}\right)\\
 & =\operatorname{{\mathds E}}_{\pi}\left(\dots\operatorname{{\mathds E}}_{\pi}\left(\dots\operatorname{{\mathds E}}_{\pi}\left(d^{r}\mid\mathcal{F}_{T}\otimes\mathcal{F}_{T}\right)\dots\mid\mathcal{F}_{t}\otimes\mathcal{F}_{t}\right)\dots\mid\mathcal{F}_{1}\otimes\mathcal{F}_{1}\right)\\
 & =\operatorname{{\mathds E}}_{\pi}d^{r};\end{aligned}$$ hence the result.

For additive cost functions the distance of the individual stages have to be taken care of. The following corollary describes the process in analogy to Proposition \[prop:Additive\] above.

\[Additive cost functions\] Let $\pi(\cdot,\cdot)$ be the optimal measure  and $c_{T}$ the additive cost function  for $r\ge1$. Then the process $$\tilde{c}_{t}^{r}+\sum_{j=1}^{t-1}d_{j}^{r}$$ is a martingale with respect to the measure $\pi$ (cf. ).

This is immediate as $\tilde{c}_{t}^{r}=c_{t}^{r}-\sum_{j=1}^{t-1}d_{j}^{r}$ by definition of the process  and as $c_{t}$ is a martingale by Theorem \[thm:Martingale\].

\[sec:ContinuityRisk\]Continuity properties
===========================================

The risk functionals defined in  above are continuous with respect to the Wasserstein distance. We generalize the results here and verify that nested risk functionals are continuous with respect to the nested distance. This section elaborates the modulus of continuity.

\[Continuity of risk functionals\] \[prop:Spectal\] Let $\mathcal{R}_{\mathcal{S}}$ be a general risk functional according . Suppose that the random variables $Y$, $\tilde{Y}\colon\Xi\to\mathbb{R}$ satisfy $$Y(x)-\tilde{Y}(y)\le L\cdot d(x,y)^{\beta}\label{eq:Cond}$$ for some $\beta\le1$. Then $$\begin{aligned}
\mathcal{R}_{\mathcal{S};P}(Y)-\mathcal{R}_{\mathcal{S};\tilde{P}}(\tilde{Y}) & \le L\cdot\sup_{\sigma\in\mathcal{S}}\left\Vert \sigma\right\Vert _{q}\cdot w_{\beta r}(P,\tilde{P})^{\beta}\\
 & \le L\cdot\sup_{\sigma\in\mathcal{S}}\left\Vert \sigma\right\Vert _{q}\cdot w_{r}(P,\tilde{P})^{\beta},\end{aligned}$$ where $q\in(1,\infty]$ is the Hölder conjugate exponent of $r$ (the order of the Wasserstein metric) for which $\frac{1}{q}+\frac{1}{r}=1$.

Let $\zeta\ge0$ with $\operatorname{{\mathds E}}\zeta=1$ be chosen so that the supremum in  is attained up to $\varepsilon>0$, i.e., $\operatorname{{\mathds E}}Y\zeta>\mathcal{R}_{\mathcal{S};P}(Y)-\varepsilon$. Let $\pi$ have marginals $P$ and $\tilde{P}$. Note that $\operatorname{{\mathds E}}_{\pi}\zeta=\operatorname{{\mathds E}}_{P}\zeta=1$, so that $$\mathcal{R}_{\mathcal{S};\tilde{P}}(\tilde{Y})=\mathcal{R}_{\mathcal{S};\pi}(\tilde{Y})\ge\operatorname{{\mathds E}}_{\pi}\tilde{Y}\zeta.$$ It follows from Hölder's inequality that $$\begin{aligned}
\mathcal{R}_{\mathcal{S};P}(Y)-\varepsilon-\mathcal{R}_{\mathcal{S};\tilde{P}}(\tilde{Y}) & \le\iint_{\Xi\times\Xi}\left(Y(x)-\tilde{Y}(y)\right)\zeta(x)\pi(\mathrm{d}x,\mathrm{d}y)\nonumber \\
 & \le L\iint_{\Xi\times\Xi}d\left(x,y\right)^{\beta}\zeta(x)\pi(\mathrm{d}x,\mathrm{d}y)\nonumber \\
 & \le L\left(\iint_{\Xi\times\Xi}d\left(x,y\right)^{\beta r}\pi(\mathrm{d}x,\mathrm{d}y)\right)^{\nicefrac{1}{r}}\left(\operatorname{{\mathds E}}\zeta^{q}\right)^{\nicefrac{1}{q}}.\label{eq:19}\end{aligned}$$ Now note that $\left(\operatorname{{\mathds E}}\zeta^{q}\right)^{\nicefrac{1}{q}}=\left\Vert \sigma\right\Vert _{q}$ where $\sigma(\cdot):=F_{\zeta}^{-1}(\cdot)\in\mathcal{S}$ is the generalized inverse distribution function. We obtain the desired result by taking the infimum in  over all possible measures with marginals $P$ and $\tilde{P}$ and after letting $\varepsilon\to0$.

For the remaining inequality observe that $$\left(\operatorname{{\mathds E}}_{\pi}d^{\beta r}\right)^{\nicefrac{1}{\beta r}}=\left\Vert d\right\Vert _{\beta r}\le\left\Vert d\right\Vert _{r}=\left(\operatorname{{\mathds E}}_{\pi}d^{r}\right)^{\nicefrac{1}{r}}$$ by Hölder's inequality, so that $$\eqref{eq:19}\le L\left(\iint_{\Xi\times\Xi}d\left(x,y\right)^{r}\pi(\mathrm{d}x,\mathrm{d}y)\right)^{\nicefrac{\beta}{r}}\cdot\sup_{\sigma\in\mathcal{S}}\left\Vert \sigma\right\Vert _{q}.$$ This is the assertion.

\[Continuity of the Average Value-at-Risk\] \[prop:AVaR\]Suppose that $Y(x)-\tilde{Y}(y)\le L\cdot d(x,y)$. Then $$\operatorname{\mathsf{AV@R}}_{\alpha;P}(Y)-\operatorname{\mathsf{AV@R}}_{\alpha;\tilde{P}}(\tilde{Y})\le\frac{L}{1-\alpha}w\left(P,\tilde{P};\,d\right).$$

This is a special case of Proposition \[prop:Spectal\] for $r=1$ and $q=\infty$ (cf. Example \[exa:AVaR\]).

\[Continuity of nested risk functionals\] \[thm:Composition\]Suppose that the random variables $Y\colon\Xi\to\mathbb{R}$ is Hölder continuous with constant $L$ and exponent $\beta\le1$, $$\left|Y(x)-Y(y)\right|\le L\cdot d(x,y)^{\beta}.$$ Then the nested risk functional $\mathcal{R}_{\mathcal{S}_{1:T}}(Y)$ is continuous with respect to the nested distance, it holds that

We infer from Proposition \[prop:Spectal\] with $\tilde{Y}=Y$ that $$\begin{aligned}
\mathcal{R}_{\mathcal{S}_{T};P\left(\cdot|\,x_{1:T-1}\right)}(Y)- & \mathcal{R}_{\mathcal{S}_{T};\tilde{P}\left(\cdot|\,y_{1:T-1}\right)}(Y)\nonumber \\
 & \le L\cdot\sup_{\sigma_{T}\in\mathcal{S}_{T}}\left\Vert \sigma_{T}\right\Vert _{q}\cdot w_{r}\left(P\left(\cdot|\,x_{1:T-1}\right),\tilde{P}\left(\cdot|\,y_{1:T-1}\right);\,c_{T}\right)^{\beta},\label{eq:21}\end{aligned}$$ where the terminal cost function is the distance as in the definition of the nested distance (cf. ), $$c_{T}=d.$$ Define the random variables $$Y_{T-1}(x_{1:T-1}):=\mathcal{R}_{\mathcal{S}_{T};P\left(\cdot|\,x_{1:T-1}\right)}(Y)\quad\text{and \quad}\tilde{Y}_{T-1}(y_{1:T-1}):=\mathcal{R}_{\mathcal{S}_{T};\tilde{P}\left(\cdot|\,y_{1:T-1}\right)}(Y),$$ so that we have $$Y_{T-1}(x_{1:T-1})-\tilde{Y}_{T-1}(y_{1:T-1})\le L\cdot\sup_{\sigma_{T}\in\mathcal{S}_{T}}\left\Vert \sigma_{T}\right\Vert _{q}\cdot c_{T-1}\left(x_{1:T},\,y_{1:T}\right)^{\beta}$$ by  and the definition of the process $c_{t}$ in . The random variables $Y_{T-1}$ and $\tilde{Y}_{T-1}$ thus satisfy the condition  with respect to the cost function $c_{T-1}$. So we may again apply Proposition \[prop:Spectal\] to the measures $P\left(\cdot\mid x_{1:T-2}\right)$ and $\tilde{P}\left(\cdot\mid y_{1:T-2}\right)$ and repeating this procedure for $t=T-2$ down to $t=0$ gives $$\mathcal{R}_{\mathcal{S}_{1:T};P}(Y)-\mathcal{R}_{\mathcal{S}_{1:T};\tilde{P}}(Y)\le\sup_{\sigma_{t}\in\mathcal{S}_{t},\,t=1,\dots T}\left\Vert \sigma_{1}\right\Vert _{q}\cdot\dots\left\Vert \sigma_{T}\right\Vert _{q}\cdot L\cdot c_{0}^{\beta},$$ with terminal cost function $c_{T}=d$. We have that $c_{0}=\operatorname{\mathsf{d\kern-.15ex I}}_{r}\left(P,\tilde{P}\right)$ and thus $$\mathcal{R}_{\mathcal{S}_{1:T};P}(Y)-\mathcal{R}_{\mathcal{S}_{1:T};\tilde{P}}(Y)\le\sup_{\sigma_{t}\in\mathcal{S}_{t},\,t=1,\dots T}\left\Vert \sigma_{1}\right\Vert _{q}\cdot\dots\left\Vert \sigma_{T}\right\Vert _{q}\cdot L\cdot\operatorname{\mathsf{d\kern-.15ex I}}_{r}\left(P,\tilde{P}\right)^{\beta}.$$

The result follows finally by exchanging the probability measures $P$ and $\tilde{P}$.

\[Continuity of the nested Average Value-at-Risk\] Suppose that $Y$ is Lipschitz continuous with constant $L$. Then the nested Average Value-at-Risk, $\operatorname{\mathsf{nAV@R}}$, is continuous with respect to the nested distance $\operatorname{\mathsf{d\kern-.15ex I}}$. More precisely, it holds that $$\left|\operatorname{\mathsf{nAV@R}}_{\alpha_{1:T};P}(Y)-\operatorname{\mathsf{nAV@R}}_{\alpha_{1:T};\tilde{P}}(Y)\right|\le\frac{L}{1-\alpha}\operatorname{\mathsf{d\kern-.15ex I}}_{r}\left(P,\tilde{P}\right)$$ for every $r\ge1$, where $\alpha\ge1-(1-\alpha_{1})\cdot\dots(1-\alpha_{T})$ (cf. ).

The statement for $r=1$ is immediate by the definition of the nested Average Value-at-Risk, Corollary \[prop:AVaR\] and Theorem \[thm:Composition\]. The statement for general $r\ge1$ follows from .

\[sec:Martingale\]Dynamic equations and the martingale property
===============================================================

In what follows we consider multistage optimization problems with cost function $$Q\colon\mathcal{Z}_{0:T}\times\Xi_{1:T}\to\mathbb{R},$$ where a sequence of subsequent decisions $z_{t}\in\mathcal{Z}_{t}$ , $t=0,\dots T,$ is chosen from $\mathcal{Z}_{0:T}=\mathcal{Z}_{0}\times\dots\times\mathcal{Z}_{T}$. To account for risk-averse decision making under uncertainty we involve risk functionals at each stage.

\[Policy\] The random variable $z_{t}\colon\Xi\to\mathcal{Z}_{t}$ is a random *policy* or *decision* at time $t$, $t=0,\dots T$. The decision $z_{t}$ is *nonanticipative* (or *adapted*) if $z_{t}\colon\Xi\to\mathcal{Z}_{t}$ is $\mathcal{F}_{t}$-measurable for every $t=0,\dots T$, abbreviated by $z_{t}\lhd\mathcal{F}_{t}$. The function $z\colon\Xi\to\mathcal{Z}_{1:T}$ with $z(x)_{t}:=z_{t}(x)$ is nonanticipative (adapted; in short, $z\lhd\mathcal{F}$), if each component $z_{t}$ is nonanticipative for every $t=0,\dots T$.

It is a consequence of the DoobDynkin lemma that $z_{t}$ is nonanticipative if it depends solely on the information available at time $t\in\{0,\dots,T\}$, i.e., if $z_{t}(x_{1:T})=\tilde{z}_{t}(x_{1:t})$ for some measurable function $\tilde{z}_{t}\colon\Xi_{1:t}\to\mathcal{Z}_{t}$ (cf. @Kallenberg2002Foundations [Lemma 1.13] or @Shiryaev1996 [Theorem II.4.3]). As the filtration $\mathcal{F}=\big(\mathcal{F}_{t}\big)_{t=0}^{T}$ is the coordinate filtration it follows that every nonanticipativative random decision $z\lhd\mathcal{F}$ can be written explicitly as $$z_{0:T}(x_{1:T})=\begin{pmatrix}\begin{array}{l}
z_{0}\\
z_{1}(x_{1})\\
z_{2}(x_{1},x_{2})\\
\quad\vdots\\
z_{T}(x_{1},\dots,x_{T})
\end{array}\end{pmatrix}$$ for adequate, measurable functions $z_{t}\colon\Xi_{0:t}\to\mathcal{Z}_{t}$.

\[Multistage optimization\] \[def:Multistage\]Let $Q\colon\mathcal{Z}_{0:T}\times\Xi_{1:T}\to\mathbb{R}\cup\{\infty\}$ be a lsc. cost function. The risk-averse multistage optimization problem is $$\inf_{z_{0:T}\lhd\mathcal{F}_{0:T}}\mathcal{R}_{\mathcal{S}_{1:T}}\Bigl(Q\bigl(z_{0:T}(\cdot);\cdot\bigr)\Bigr),\label{eq:multiStage}$$ where the infimum is among all adapted policies $z\lhd\mathcal{F}$. We emphasize and indicated the random component in  by '$\cdot$'.

To avoid confusions or ambiguities regarding the arguments of the function $Q$ we separate the arguments $z\in\mathcal{Z}_{0:T}$ and $x\in\Xi_{1:T}$ explicitly and write $Q(z;x)$. This will turn out helpful in what follows, for example in expressions as $Q(z_{0:t-1},z_{t:T};\,x_{1:t},x_{t+1:T})$.

Constraints of the form $z_{0:t}(x_{1:t})\in\mathscr{Z}_{t}(x_{1:t})\subseteq\mathcal{Z}_{t}$ for some multifunction $\mathscr{Z}_{t}(\cdot)$ appear naturally in applications involving optimization under uncertainty. They are easily incorporated in the problem formulation  just by employing the function $Q(z_{0:T},x_{1.T})\cdot\operatorname{{\mathds 1}}_{\mathscr{Z}_{t}(x_{1:t})}(z_{0:T})$ instead of $Q$. This setting is not advisable for real world implementations, but convenient for the conceptual treatment envisaged here.

The multistage problem  thus consists in finding optimal functions $z_{0},\,z_{1}(\cdot),\dots,z_{T}(\cdot)$ (only $z_{0}$ is deterministic) and therefore can be considered as *optimization on function spaces*.

The essential infimum
---------------------

We shall make use of the following interchangeability principle, cf. also @ShapiroInterchangeability. For $z\in\mathcal{Z}$ fixed, the mapping $x\mapsto Q(z,x)$ is a random variable for which we write $Q(z,\cdot)$. In what follows we discuss the expression $\inf_{z}Q(z,\cdot)$ and its measurability. We refer to @Karatzas [Appendix A] for a formal definition of the essential infimum $\operatorname*{ess\,inf}_{z\in\mathcal{Z}}Q(z,\cdot)$, which is a measurable random variable as well.

\[prop:Essinf\]Let $\mathcal{Z}$ be a vector space and consider all policies with values $z(\cdot)\in\mathcal{Z}$. Then there exists a sequence $z_{n}(\cdot)$ of simple functions so that $$\lim_{n\to\infty}Q\big(z_{n}(\cdot),\cdot\big)=\operatorname*{ess\,inf}_{z(\cdot)\in\mathcal{Z}}Q(z(\cdot),\cdot)\qquad\text{almost surely}\label{eq:16}$$ and $Q\big(z_{n}(\cdot),\cdot\big)$ is nonincreasing.

Denote the set of simple functions $z(\cdot)=\sum_{i=1}^{k}a_{i}\operatorname{{\mathds 1}}_{A_{i}}(\cdot)$ by $s$. For $z(\cdot)$ and $z^{\prime}(\cdot)$ simple functions define $$z^{\prime\prime}(x):=\begin{cases}
z(x) & \text{if }Q\big(z(x),x\big)\le Q\big(z^{\prime}(x),x\big),\\
z^{\prime}(x) & \text{else},
\end{cases}\label{eq:Max}$$ which is a simple function again and measurable. (The maximization  actually defines a directed set or preorder on $s$.) It holds that $Q(z^{\prime\prime}(\cdot),\cdot)\le Q(z^{\prime}(\cdot),\cdot)$ and $Q(z^{\prime\prime}(\cdot),\cdot)\le Q(z(\cdot),\cdot)$ and the set $\left\{ Q(z(\cdot),\cdot)\colon z\in s\right\} $ thus is closed under pairwise minimization. It follows from @Karatzas [Theorem A.3] that there is a sequence $z_{n}(\cdot)$ of simple functions so that $$\operatorname*{ess\,inf}_{z(\cdot)}Q\big(z(\cdot),\cdot\big)=\lim_{n\to\infty}Q\big(z_{n}(\cdot),\cdot\big)\qquad\text{almost everywhere}$$ and thus the assertion.

\[cor:Inf\]Let $s$ be a set of policies containing all simple functions and suppose that $$x\mapsto Q(z,x)\label{eq:usc}$$ is upper semi-continuous for every $z\in\mathcal{Z}$. Then there exists a sequence $z_{n}(\cdot)$ of policies so that $$\lim_{n\to\infty}Q\big(z_{n}(\cdot),\cdot\big)=\inf_{z\in\mathcal{Z}}Q(z,\cdot)\qquad\text{ almost everywhere}.$$

The set $s$ contains the constant functions and thus $$\inf_{z\in\mathcal{Z}}Q(z,x)=\inf_{z(\cdot)\in\mathcal{Z}}Q\big(z(x),x\big)\qquad\text{for every }x.$$ We have that $\left\{ x\colon\inf_{z\in\mathcal{Z}}Q(z,x)<\alpha\right\} =\bigcup_{z\in\mathcal{R}}\left\{ x\colon Q(z,x)<\alpha\right\} $ for every $\alpha\in\mathbb{R}$ so that the additional assumptions ensure that $x\mapsto\inf_{z\in\mathcal{Z}}Q(z,x)$ is measurable. The assertion thus follows as $$\inf_{z(\cdot)\in\mathcal{Z}}Q\big(z(\cdot),\cdot\big)=\operatorname*{ess\,inf}_{z(\cdot)\in\mathcal{Z}}Q(z(\cdot),\cdot)=\lim_{n\to\infty}Q\big(z_{n}(\cdot),\cdot\big),$$ where $z_{n}(\cdot)$ is the sequence found in Proposition \[prop:Essinf\].

\[def:Infimum\]In what follows we shall always understand the measurable version when writing $\inf_{z\in\mathcal{Z}}Q(z,\cdot)$, i.e., we set $$\inf_{z\in\mathcal{Z}}Q(z,\cdot):=\operatorname*{ess\,inf}_{z(\cdot)\in\mathcal{Z}}Q(z(\cdot),\cdot).\label{eq:Convention}$$

The preceding Corollary \[cor:Inf\] provides general conditions so that the convention is void and automatically valid in these cases.

\[<span>Risk functional at the essential infimum, cf. @RuszczynskiShapiro2009 [Proposition 6.60]</span>\] \[prop:R1\]Suppose that $\mathcal{R}$ is continuous at $\inf_{z}Q(z,\cdot)$ with respect to convergence in $L^{p}$. Then it holds that $$\inf_{z(\cdot)\in\mathcal{Z}}\mathcal{R}\big(Q(z(\cdot),\cdot)\big)=\mathcal{R}\left(\inf_{z\in\mathcal{Z}}Q\big(z,\cdot\big)\right).$$

The result is a consequence Lebesgue's dominated convergence theorem in view of our setting  and the representation as nonincreasing limit given in .

Martingale characterization
---------------------------

Section \[subsec:Martingale\], in particular Theorem \[thm:Martingale\], characterize the nested distance as a martingale process. This concept extends to the value process of the stochastic optimization problem when generalizing the concept of martingales. We incorporate risk awareness in the definition of the martingale term first and characterize the optimal solution of the multistage stochastic optimization problem as a martingale with respect to the risk functionals involved.

\[Risk martingale\] The stochastic process $v=(v_{t})_{t=0}^{T}$ is a *submartingale* (*supermartingale*, resp.) *with respect to the risk functionals* $\mathcal{R_{S}}_{t}$ (an $\mathcal{R}$-submartingale, for short), if $$v_{t}\le\mathcal{R_{S}}_{t+1}(v_{t+1})\text{ a.s.}\qquad(v_{t}\ge\mathcal{R_{S}}_{t+1}(v_{t+1})\text{ a.s., resp.})\label{eq:7-1}$$ for very $t\in\{0,1,\dots T\}$. The process $v_{t}$ is an $\mathcal{R}$-martingale, if holds with equality.

For the expectation, $\mathcal{R}=\mathbb{E}$, the notion of an $\mathcal{R}$-martingale (sub-, supermartingale, resp.) coincides with the usual term martingale (sub-, supermartingale, resp.).

\[rem:Martingale\]A process $v=(v_{t})_{t=0}^{T}$, which is an $\mathcal{R}$-submartingale, satisfies in addition $$v_{s}\le\mathcal{R}_{S_{s+1:t}}(v_{t}),\qquad0\le s<t<T.$$ This follows as the risk functionals $\mathcal{R}_{\mathcal{S}_{t}}$ are monotone (Axiom \[enu:Monotonicity\]) and from the recursive definition of the nested risk functional given in Definition \[def:NestedRisk\].

Let $z=(z_{t})_{t=0}^{T}$ be an adapted policy. Then the process $$v_{t}(x_{1:t}):=\mathcal{R}_{S_{t+1:T}}\Bigl(Q\big(z_{0:t}(x_{1:t}),z_{t+1:T}(x_{1:t},\cdot);x_{1:t},\cdot\big)\mid x_{1:t}\Bigr)\label{eq:7-2}$$ is an $\mathcal{R}$-martingale with terminal value $$v_{T}=Q\big(z_{0:T}(\cdot);\cdot\big).\label{eq:MartEnd}$$

Choosing $t=T$ in the defining equation  gives $v_{T}(x_{1:T})=Q\big(z_{0:T}(x_{1:T});x_{1:T}\big)$ and thus .

Apply $\mathcal{R}_{\mathcal{S}_{T}}$ and it follows from  that $$\begin{aligned}
\mathcal{R}_{S_{T}}\Bigl(v_{T}\mid x_{1:T-1}\Bigr) & =\mathcal{R}_{S_{T}}\Bigl(Q\big(z_{0:T}(x_{1:T});x_{1:T}\big)\mid x_{1:T-1}\Bigr)\\
 & =\mathcal{R}_{S_{T}}\Bigl(Q\big(z_{0:T-1}(x_{1:T-1}),z_{T:T}(x_{1:T-1},\cdot);x_{1:T-1},\cdot\big)\mid x_{1:T-1}\Bigr)\\
 & =v_{T-1}(x_{1:T-1}),\end{aligned}$$ as $z$ is adapted. This is the desired martingale property for $t=T-1$.

Apply next $\mathcal{R}_{\mathcal{S}_{T-1}}$ to the latter equation and observe that $$v_{T-2}(x_{1:T-2})=\mathcal{R}_{S_{T-1:T}}\Bigl(Q\big(z_{0:T-1}(x_{1:T-1});x_{1:T-1}\big)\mid x_{1:T-2}\Bigr)=\mathcal{R}_{S_{T-1:T}}\Bigl(v_{T-1}(x_{1:T-1})\mid x_{1:T-2}\Bigr),$$ which is the assertion for $t=T-1$. The general assertion is immediate by repeatedly applying the risk functional corresponding to the individual stage.

As a consequence we have the following immediate property of an optimal policy.

\[cor:Optimal\]Let $z_{0:T}^{*}\colon\Xi\to\mathcal{Z}_{0:T}$ be an optimal policy in the multistage stochastic optimization problem  and $v^{*}=(v_{t}^{*})_{t=0}^{T}$ the value process  associated with the policy $z_{0:T}^{*}$. Then $v^{*}$ is an $\mathcal{R}$-martingale and the starting value $v_{0}^{*}$ is the solution of the optimization problem .

The value process is a martingale
---------------------------------

Associated with the optimal solution of the reference problem  is an optimal policy. We shall characterize the evolution of this process now by highlighting their martingale properties.

\[The value process\] Let $z_{0:T}\colon\Xi\to\mathcal{Z}_{0:T}$ be a policy. The *value process* associated with the policy $z_{0:T}$ is $v(z):=\big(v_{t}(z)\big){}_{t=0}^{T}$. The marginal functions $v_{t}(z):=v_{t}(z_{0:t-1}\mid\cdot)\colon\Xi_{0:t}\to\mathbb{R}$ are defined by $$v_{t}(z_{0:t-1}\mid x_{1:t}):=\inf_{z_{t:T}\lhd\mathcal{F}_{t:T}}\mathcal{R}_{S_{t+1:T}}\Bigl(Q\big(z_{0:t-1}(x_{1:t}),z_{t:T}(x_{1:t},\cdot);x_{1:t},\cdot\big)\mid x_{1:t}\Bigr),\qquad t=0,\dots T,\label{eq:Value}$$ where the infimum in  is among all adapted processes $z_{t:T}(x_{1:T})=\begin{pmatrix}\begin{array}{l}
z_{t}(x_{1},\dots x_{t})\\
\qquad\vdots\\
z_{T}(x_{1},\dots,x_{t},\dots,x_{T})
\end{array}\end{pmatrix}$.

The value process at initial time $t=0$ is $$v_{0}^{*}:=\inf_{z_{0:T}\lhd\mathcal{F}_{0:T}}\mathcal{R}_{\mathcal{S}_{1:T}}\Bigl(Q\bigl(z_{0:T}(\cdot);\cdot\bigr)\Bigr),$$ this value coincides with the risk-averse multistage stochastic program  given in Definition \[def:Multistage\]. The quantity $v_{0}^{*}$ is a deterministic number and not random.

In addition, we have for $t=T$ that $$v_{T}(z_{0:T-1}\mid x_{1:T})=\inf_{z_{T}\lhd\mathcal{F}_{T}}Q\Big(z_{0:T-1}(x_{1:T}),z_{T}(x_{1:T});x_{1:T}\Big),$$ so that the terminal value function does not involve a risk measure any longer and the terminal optimization problem is deterministic, i.e., not random either.

\[Submartingale characterization of the value process\] \[thm:Submartingale\]The value process is an $\mathcal{R}$-submartingale for any given policy $z_{0:T}$.

We have that $$\begin{aligned}
\mathcal{R}_{\mathcal{S}_{t+1}}\left(v_{t+1}\right) & =\mathcal{R}_{\mathcal{S}_{t+1}}\left(\inf_{z_{t+1:T}\lhd\mathcal{F}_{t+1:T}}\mathcal{R}_{S_{t+2:T}}\Bigl(Q\big(z_{0:t}(x_{1:t+1}),z_{t+1:T}(x_{1:t+1},\cdot);x_{1:t+1},\cdot\big)\mid x_{1:t+1}\Bigr)\right)\nonumber \\
 & =\inf_{z_{t+1:T}\lhd\mathcal{F}_{t+1:T}}\mathcal{R}_{\mathcal{S}_{t+1}}\left(\mathcal{R}_{S_{t+2:T}}\Bigl(Q\big(z_{0:t}(x_{1:t+1}),z_{t+1:T}(x_{1:t+1},\cdot);x_{1:t+1},\cdot\big)\mid x_{1:t+1}\Bigr)\right)\label{eq:19-1}\\
 & =\inf_{z_{t+1:T}\lhd\mathcal{F}_{t+1:T}}\mathcal{R}_{\mathcal{S}_{t+1:T}}\Bigl(Q\big(z_{0:t}(x_{1:t+1}),z_{t+1:T}(x_{1:t+1},\cdot);x_{1:t+1},\cdot\big)\mid x_{1:t+1}\Bigr),\label{eq:20}\end{aligned}$$ where we have employed  in .

The result follows now, as that value process  is the infimum among all $z_{t:T}\lhd\mathcal{F}_{t:T}$, while the infimum in  is among $z_{t:T}\lhd\mathcal{F}_{t:T}$, which is one dimension less.

Dynamic optimization employs verification theorems which give sufficient conditions for a solution to the optimal control problem, cf. @Fleming1993 [Theorems 5.1 and 5.2]. The following theorem provides the corresponding statement for the risk-averse multistage stochastic problem.

\[Martingale characterization, dynamic equations, verification theorem\] For the value process it holds that $$v_{0}^{*}=\inf_{z_{0:t}\lhd\mathcal{F}_{0:t}}\mathcal{R}_{\mathcal{S}_{1:t}}\bigl(v_{t}(z_{0:t})\bigr),\qquad t\in\{0,1,\dots,T\}.$$ More generally, for $s<t$ we have the recursive equations $$v_{s}(z_{0:s-1})=\inf_{z_{s:t}\lhd\mathcal{F}_{s:t}}\mathcal{R}_{\mathcal{S}_{s+1:t}}\bigl(v_{t}(z_{1:s},z_{s+1:t})\bigr).\label{eq:17}$$

Applying the conditional risk functional $\mathcal{R}_{\mathcal{S}_{t}}(\cdot\mid x_{1:t-1})$ to  gives $$\begin{aligned}
\mathcal{R}_{\mathcal{S}_{t}}\Big(v_{t}(z_{0:t-1}\mid x_{1:t})| & x_{1:t-1}\Big)=\mathcal{R}_{\mathcal{S}_{t}}\left(\inf_{z_{t:T}\lhd\mathcal{F}_{t:T}}\mathcal{R}_{S_{t+1:T}}\Bigl(Q\big(z_{0:t-1}(x_{1:t}),z_{t:T}(x_{1:t},\cdot);x_{1:t},\cdot\big)\mid x_{1:t}\Bigr)\mid x_{1:t-1}\right)\nonumber \\
 & =\inf_{z_{t:T}\lhd\mathcal{F}_{t:T}}\mathcal{R}_{\mathcal{S}_{t}}\left(\mathcal{R}_{S_{t+1:T}}\Bigl(Q\big(z_{0:t-1}(x_{1:t}),z_{t:T}(x_{1:t},\cdot);x_{1:t},\cdot\big)\mid x_{1:t}\Bigr)\mid x_{1:t-1}\right)\label{eq:18}\\
 & =\inf_{z_{t:T}\lhd\mathcal{F}_{t:T}}\mathcal{R}_{\mathcal{S}_{t:T}}\left(Q\big(z_{0:t-1}(x_{1:t}),z_{t:T}(x_{1:t},\cdot);x_{1:t},\cdot\big)\mid x_{1:t-1}\Bigr)\right),\nonumber \end{aligned}$$ where we have used the montonicity axiom, \[enu:Monotonicity\] and Propositon \[rem:infimum\] to obtain "$\le$" in . The converse inequality "$\ge"$ involves the Lebesgue Dominated Convergence Theorem and is a consequence of Proposition \[prop:R1\].

At this stage take the infimum with respect to $z_{t-1}\lhd\mathcal{F}_{t-1}$ and thus $$\begin{aligned}
\inf_{z_{t-1}\lhd\mathcal{F}_{t-1}}\mathcal{R}_{\mathcal{S}_{t}}\left(v_{t}(z_{0:t-1}\mid x_{1:t})|x_{1:t-1}\right) & =\inf_{z_{t-1:T}\lhd\mathcal{F}_{t-1:T}}\mathcal{R}_{\mathcal{S}_{t:T}}\left(Q\big(z_{0:t-1}(x_{1:t}),z_{t:T}(x_{1:t},\cdot);x_{1:t},\cdot\big)\mid x_{1:t-1}\Bigr)\right)\\
 & =v_{t-1}(z_{0:t-2}\mid x_{1:t-1}),\end{aligned}$$ which is the martingale property of the value process $v(z)$. The remaining equation  follows in line with Remark \[rem:Martingale\].

The converse inequalities follow from the submartingale characterization, Theorem \[thm:Submartingale\].

The dynamic equations derived in this section can be employed to characterize optimal solution of the multistage stochastic optimization problem. The conceptual advantage lies in the fact that each stage can be considered for its own. For this the dynamic equations can be employed in algorithms to improve suboptimal policies at each stage individually.

\[sec:Continuity\]Continuity of risk-averse multistage programs
===============================================================

The value of the risk-averse multistage stochastic optimization problem  depends on the probability measure $P$. We shall make this explicit by writing $$v_{P}:=\inf_{z_{0:T}\lhd\mathcal{F}_{0:T}}\mathcal{R}_{\mathcal{S}_{1:T};P}\Bigl(Q\bigl(z_{0:T}(\cdot);\cdot\bigr)\Bigr).\label{eq:7-3}$$ It is known that the *risk-neutral* version of the multistage problem  is continuous with respect to changing the probability measure.

The following main result elaborates continuity of the *risk-averse* problem with respect to the nested distance and gives the modulus of continuity explicitly.

\[Continuity of the risk-averse MSO problem\] \[thm:47\]Suppose that $$x\mapsto Q(z;x),\qquad z\in\mathcal{Z},$$ is uniformly Lipschitz, i.e., $$\left|Q(z;x)-Q(z;y)\right|\le L\cdot d(x,y)\quad\text{ for all }x,y\in\Xi_{1:T}\text{ and }z\in\mathcal{Z}\label{eq:Lipschitz}$$ and $$z\mapsto Q(z;x)\qquad(x\in\Xi_{1:T})$$ is convex for every $x$ fixed. Then the risk-averse optimization problem  is continuous with respect to changing the probability measure. More specifically, we have that $$\left|v_{P}-v_{\tilde{P}}\right|\le\sup_{\sigma\in\mathcal{S}_{t},\,t=1,\dots T}\left\Vert \sigma_{1}\right\Vert _{q}\cdot\dots\left\Vert \sigma_{T}\right\Vert _{q}\cdot L\cdot\operatorname{\mathsf{d\kern-.15ex I}}_{r}(P,\tilde{P}),$$ where the exponents $r$ and $q$ are Hölder conjugates, $\frac{1}{r}+\frac{1}{q}=1$.

The assumption on Lipschitz continuity of the function $Q$ notably insures the Convention \[def:Infimum\] as $Q$ is particularly usc., cf. .

\[Proof of Theorem \[thm:47\]\] To compare with the second problem $v_{\tilde{P}}$ define the new policy $$\tilde{z}_{t}(y_{1:t}):=\operatorname{{\mathds E}}_{\pi}\bigl(z_{t}(x)\mid\operatorname{\mathsf{pr}}_{t}(x,y)=y_{1:t}\bigr),$$ where $\operatorname{\mathsf{pr}}_{t}(x_{1:t},y_{1:t}):=y_{1:t}$ is the projection onto the second marginal and consider the specific random variables $$Y_{t}(x_{1:t}):=\mathcal{R}_{\mathcal{S}_{t+1:T};P(\cdot\mid x_{1:t})}\Big(Q\big(z_{0:t},z_{t+1:T}(x_{1:t},\cdot);x_{1:t},\cdot\big)\Big)\label{eq:53}$$ and $$\tilde{Y}_{t}(y_{1:t}):=\mathcal{R}_{\mathcal{S}_{t+1:T};\tilde{P}(\cdot\mid y_{1:t})}\Bigl(Q\big(z_{0:t},\tilde{z}_{t+1:T}(y_{1:t},\cdot);y_{1:t},\cdot\big)\Bigr),\label{eq:54}$$ where $z_{0:t}\in\mathcal{Z}$ is fixed and '$\cdot$' indicates the random component.

For $\varepsilon>0$ pick a policy $z=\bigl(z_{0:t}(x_{1:t})\bigr)_{t=1}^{T}$ so that $$v_{P}>\mathcal{R}_{\mathcal{S}_{1:T};P}\bigl(Q(z_{0:T}(\cdot);\cdot)\bigr)-\varepsilon.\label{eq:Gewahlt}$$ Further, let the measure $\pi(\cdot,\cdot)$ have conditional marginals $P(\cdot)$ and $\tilde{P}(\cdot)$ with respect to the nested distance, cf. .

In line with Definition \[def:Nested\] we set $c_{T}:=d$ and proceed by backwards induction from $t=T$ down to $t=0$.

Base case: Note that $Y_{T}(x_{1:T})=Q(z_{0:T};x_{1:T})$ and $\tilde{Y}_{T}(y_{1:T})=Q(z_{0:T};y_{1:T})$. By Lipschitz continuity  it holds that $\tilde{Y}_{T}(y_{1:T})-Y_{T}(x_{1:T})\le L\cdot d(x_{1:T},y_{1:T})$. This is the statement $$\tilde{Y}_{t}(y_{1:t})-Y_{t}(x_{1:t})\le L\cdot\sup_{\sigma\in\mathcal{S}_{t+1:T}}\left\Vert \sigma_{t+1}\right\Vert _{q}\cdot\ldots\left\Vert \sigma_{T}\right\Vert _{q}\cdot c_{t}(x_{1:t},y_{1:t})\label{eq:17-2}$$ for the case $t=T$ (and by setting the empty product to $\prod_{t\in\emptyset}f_{t}:=1$).

Inductive step: In what follows we shall employ the statement  as induction hypothesis and deduce the statement for $t-1$ instead of $t$. From Jensen's inequality we infer that $$Q\left(\tilde{z}(y);y\right)=Q\left(\operatorname{{\mathds E}}_{\pi}\bigl(z(x)\mid\operatorname{\mathsf{pr}}_{t}(x,y)=y\bigr);y\right)\le\operatorname{{\mathds E}}_{\pi}\left(Q\bigl(z(x);y)\mid\operatorname{\mathsf{pr}}(x,y)=y\right).\label{eq:7}$$ To be more specific we emphasize that $z$ is a vector of functions, $z=(z_{t})_{t=0}^{T}$ and further, each $z_{t}$ is a function of the variables $x_{1},\dots,x_{t}$, $z_{t}=z_{t}(x_{1:t})$. Jensen's inequality applies to each function $z_{t}$ and each argument $x_{t}$ separately, so that the inequality  is actually the result of applying Jensen's inequality $t$ times repeatedly at each stage $t$.

Now let $\zeta$ be chosen so that $\operatorname{{\mathds E}}\tilde{Y}_{t}\zeta>\mathcal{R}_{\mathcal{S}_{t:T};\tilde{P}(\cdot\mid y_{1:t-1})}(\tilde{Y}_{t})-\varepsilon^{\prime}$ and $\operatorname{\mathsf{AV@R}}_{\alpha}(\zeta)\le\frac{1}{1-\alpha}\int_{\alpha}^{1}\sigma(u)\mathrm{d}u$ ($\alpha\in(0,1)$) for some $\sigma(\cdot)\in\mathcal{S}_{t}$. As the risk functional is recursive we deduce from  and  that $$\begin{aligned}
\tilde{Y}_{t-1}-Y_{t-1}-\varepsilon^{\prime} & =\mathcal{R}_{\mathcal{S}_{t:T};\tilde{P}(\cdot\mid y_{1:t-1})}(\tilde{Y}_{t})-\varepsilon^{\prime}-\mathcal{R}_{\mathcal{S}_{t:T};P(\cdot\mid x_{1:t-1})}(Y_{t})\\
 & \le\operatorname{{\mathds E}}_{\pi}Q\big(\tilde{z}(y);y\big)\zeta(y)-\operatorname{{\mathds E}}_{\pi}Q\big(z(x);x\big)\zeta(y)\\
 & \le\operatorname{{\mathds E}}_{\pi}\operatorname{{\mathds E}}_{\pi}\left(Q\bigl(z(x);y)\mid\operatorname{\mathsf{pr}}(x,y)=y\right)\zeta(y)-\operatorname{{\mathds E}}_{\pi}Q\left(z(x);x\right)\zeta(y),\end{aligned}$$ where we have used . By the tower property of the conditional expectation, Lipschitz continuity  and Hölder's inequality it follows further that $$\begin{aligned}
\tilde{Y}_{t-1}-Y_{t-1}-\varepsilon^{\prime} & \le\operatorname{{\mathds E}}_{\pi}Q\bigl(z(x);y)\zeta(y)-\operatorname{{\mathds E}}_{\pi}Q\left(z(x);x\right)\zeta(y)\\
 & \le\operatorname{{\mathds E}}_{\pi}\zeta(y)c_{t}(x_{1:t},y_{1:t})\\
 & \le L\sup_{\sigma\in\mathcal{S}_{t:T}}\left\Vert \sigma_{t}\right\Vert _{q}\cdot\ldots\left\Vert \sigma_{T}\right\Vert _{q}w_{r}\left(P(\cdot\mid x_{1:t-1}),\tilde{P}(\cdot\mid y_{1:t-1});\,c_{t}\right)\\
 & =L\sup_{\sigma\in\mathcal{S}_{t:T}}\left\Vert \sigma_{t}\right\Vert _{q}\cdot\ldots\left\Vert \sigma_{T}\right\Vert _{q}\cdot c_{t}(x_{1:t-1},y_{1:t-1}),\end{aligned}$$ as $\pi$ has conditional marginals $\tilde{P}(\cdot\mid y_{1:t-1})$ and $P(\cdot\mid x_{1:t-1})$. By letting $\varepsilon^{\prime}\to0$ we get the assertion  for $t-1$. By repeatedly applying the previous reasoning we thus get that $$\begin{aligned}
\tilde{Y}_{0}-Y_{0} & \le L\sup_{\sigma\in\mathcal{S}_{1:T}}\left\Vert \sigma_{1}\right\Vert _{q}\cdot\ldots\left\Vert \sigma_{T}\right\Vert _{q}\cdot\operatorname{\mathsf{d\kern-.15ex I}}_{r}(P,\tilde{P}).\label{eq:17-4}\end{aligned}$$ Now note that $v_{P}>Y_{0}-\varepsilon$ by  and we thus have found a policy $\tilde{z}$ so that $v_{\tilde{P}}\le\tilde{Y}_{0}.$ It follows with  that $$v_{\tilde{P}}-v_{P}\le\tilde{Y}_{0}-\left(Y_{0}-\varepsilon\right)\le L\sup_{\sigma\in\mathcal{S}_{1:T}}\left\Vert \sigma_{1}\right\Vert _{q}\cdot\ldots\left\Vert \sigma_{T}\right\Vert _{q}\cdot\operatorname{\mathsf{d\kern-.15ex I}}_{r}(P,\tilde{P})+\varepsilon.$$

The result finally follows by letting $\varepsilon\to0$ and by interchanging the role of $P$ and $\tilde{P}$.

Summary 
========

This paper addresses risk-averse stochastic optimization problems. To define the risk functionals based on partial observations we introduce conditional risk measures first. They are defined on fibers and can be composed to nested risk measures. We demonstrate that these nested risk measures are continuous and we establish the modulus of continuity. As a consequence, the optimization problems are continuous as well, these problems inherit the modulus of continuity from the risk functionals.

All results come along with characterizations as generalized martingales. It is demonstrated that the underlying distance is a usual martingale with respect to the natural filtration. The value functions are shown to follow a generalized, risk-averse martingale pattern as well.

Acknowledgment
==============

We would like to thank Prof. Shapiro for proposing to elaborate the continuity relations of nested risk measures with respect to the nested distance.

[^1]: Contact: <walkerjohn@example.net>

[^2]: Both authors: Technische Universität Chemnitz, 09126 Chemnitz, Germany

{'source': 'arXiv_out/1802'}