Representation for the Gauss-Laplace Transmutation
Under certain conditions, a symmetric unimodal continuous random variable $\xi$ can be represented as a scale mixture of the standard Normal distribution $Z$, i.e., $\xi = \sqrt{W} Z$, where the mixing distribution $W$ is independent of $Z.$ It is well known that if the mixing distribution is inverse Gamma, then $\xi$ is student's $t$ distribution. However, it is less well known that if the mixing distribution is Gamma, then $\xi$ is a Laplace distribution. Several existing proofs of the latter result rely on complex calculus and change of variables in integrals. We offer two simple and intuitive proofs based on representation and moment generating functions.
\section{Main Result to Prove}


Let $\text{Expo}(1)$ denote the standard Exponential distribution with mean one, $\text{Laplace}$ the standard Laplace distribution with mean zero and variance two, $N(\mu,\sigma^2)$ the Normal distribution with mean $\mu$ and variance $\sigma^2.$ If two random variables $A$ and $B$ have the same distribution, then we write $A\sim B.$
The Gauss--Laplace transmutation states that
$$
V\sim 2\text{Expo}(1),\quad L\mid V\sim N(0, V) \Longrightarrow L\sim \text{Laplace},
$$ 
or equivalently, if $\text{Expo}\sim \text{Expo}(1)$ is independent of $Z\sim N(0,1)$, then
$$
L = \sqrt{2 \text{Expo}} Z \sim \text{Laplace}.
$$
Interestingly, the Laplace and Normal distributions are Pierre-Simon Laplace's first and second law of errors \citep{wilson1923first}, which are tied together by a scaling factor $\sqrt{2 \text{Expo}}.$ In high dimensional statistics, this result is crucial to efficiently simulate posterior distribution of the Bayesian Lasso \citep{park2008bayesian}, which imposes Laplace priors on the regression coefficients. Some proofs of the Gauss--Laplace transmutation exist in the literature \citep{andrews1974scale, west1987scale}, which rely on advanced theory of complex calculus. In this note, we offer two simple proofs based on representation and moment generating functions (MGFs). 



\section{Review of Some Basic Representations}


Let $Z\sim N(0,1), \text{Expo}\sim \text{Expo}(1), X^2_k\sim \chi^2_k$, and $L\sim \text{Laplace}$. We use these symbols for Normal, Exponential, Chi-Squared, and Laplace random variables from now on. We also use $S$ for a random sign taking values $\pm 1$ with probabilities $1/2.$
Let IID denote ``independently and identically distributed.'' The following representations are useful.

\begin{enumerate}
[(a)]
\item\label{rep:a}
If $Z_1, Z_2$ are IID $N(0,1)$, then $ 2\text{Expo}\sim X^2_{2}\sim Z_1^2+Z_2^2$.

\begin{proof}
Let $\text{Gamma}(a)$ be a Gamma random variable with shape parameter $a$ and rate parameter one. 
We have $2\text{Expo}\sim 2 \text{Gamma}(1) \sim X^2_2$ by the relationship between Gamma and Chi-Squared random variables, and $2\text{Expo}\sim Z_1^2 + Z_2^2$ by the definition the Chi-Squared random variable. 
\end{proof}

\item\label{rep:b}
If $Z_1, Z_2$ are IID $N(0,1)$, then $Z_1Z_2\sim (Z_1^2-Z_2^2)/2.$

\begin{proof}
Because the bivariate Normal distributions satisfy $(Z_1,Z_2)\sim (Z_1+Z_2, Z_1-Z_2)/\sqrt{2}$, we have $Z_1Z_2\sim (Z_1+Z_2)( Z_1-Z_2)/2 = (Z_1^2-Z_2^2)/2.$
\end{proof}



\item\label{rep:c}
If $\text{Expo}_1, \text{Expo}_2$ are IID $\text{Expo}(1)$ independent of $S$, then $L\sim S \text{Expo}_1 \sim  \text{Expo}_1 - \text{Expo}_2.$

\begin{proof}
Obviously, $L\sim S \text{Expo}_1$, which justifies the other name, double exponential, of the Laplace distribution. By symmetry and the memoryless property, we have 
$$
\text{Expo}_1 - \text{Expo}_2\sim S \{  \max(\text{Expo}_1, \text{Expo}_2)  - \min(\text{Expo}_1, \text{Expo}_2)   \} 
\sim  S  \text{Expo}_1.
$$
\end{proof}

\end{enumerate}



\section{A Proof Based on Representation}




\begin{proof}
We let $Z, Z_1,Z_2,Z_3,Z_4$ be IID $N(0,1)$, and $\text{Expo}_1,\text{Expo}_2$ be IID $\text{Expo}(1).$
Using representation (\ref{rep:a}), we have 
$$
L = \sqrt{2 \text{Expo}} Z\sim \sqrt{ Z_1^2 + Z_2^2 } Z.
$$ 
By conditioning on $(Z_1,Z_2)$, we have
$$
Z_1Z_3 + Z_2Z_4  \sim N(0,    Z_1^2 + Z_2^2) \sim \sqrt{ Z_1^2 + Z_2^2 } Z,
$$
which implies 
$
L\sim Z_1Z_3 + Z_2Z_4.
$ 
Using representation (\ref{rep:b}), we have 
$$
L\sim (Z_1^2-Z_3^2)/2 + (Z_2^2-Z_4^2)/2 = (Z_1^2+Z_2^2)/2  - (Z_3^2+Z_4^2)/2 .
$$
Using representation (\ref{rep:a}) again, we have
$
L\sim \text{Expo}_1 - \text{Expo}_2.
$
Therefore, the final result follows from representation (\ref{rep:c}).
\end{proof}






\section{A Proof Based on Moment Generating Functions}


The MGF of $Z$ is $M_N(t) = E(e^{tZ}) = e^{t^2/2}$, and the MGF of $\text{Expo}$ is $M_E(t) = E(e^{t\text{Expo}}) = 1/(1-t)$ for $ t <1.$ We can prove the result by calculating the MGFs directly.



\begin{proof}
Using the known MGFs above and two conditional arguments, we can verify that
the MGF of $\sqrt{2 \text{Expo}} Z $ is
$$
E( e^{t\sqrt{2 \text{Expo}} Z } ) 
=E\{   E( e^{t\sqrt{2 \text{Expo}} Z } \mid \text{Expo})  \}
=       E\{   M_N(t\sqrt{2 \text{Expo}}) \}
=       E\{      e^{t^2 \text{Expo}} \}
= M_E(t^2)
=     {1\over 1-t^2} ,
$$
and the MGF of $L\sim \text{Laplace}\sim S \text{Expo}$ is
$$
E(e^{tS\text{Expo}}) 
= E\{  E(e^{tS\text{Expo}} \mid S)  \}
=  E\{  M_E(tS) \}
=  E\left  ( 1 \over 1-tS \right) 
= \frac{1}{2}\left(  \frac{1}{1-t} + \frac{1}{1+t}  \right)
= {1\over 1-t^2} .
$$
\end{proof}




\section{Discussion}





Because of representation (\ref{rep:a}), we have $\sqrt{2 \text{Expo}} Z \sim S \sqrt{X^2_1 X^2_2}$ and $L\sim S\text{Expo}\sim S X_2^2/2$. Therefore, the Gauss--Laplace transmutation reduces to $4 X^2_1 X^2_2 \sim (X_2^2)^2$. In fact, a general result holds: $4 X^2_{k}  X^2_{k+1} \sim (X^2_{2k})^2.$ This is the stochastic analogue of Legendre's duplication formula for Gamma functions as discussed in \citet{gordon1989bounds}, \citet{gordon1994stochastic} and the Supplementary Materials.



The proof by representation also establishes the result $    \sqrt{X_2^2} Z\sim  Z_1Z_3 + Z_2Z_4$. In fact, a general result holds: $\sqrt{X_n^2} Z \sim \sum_{i=1}^n Z_{1i} Z_{2i}$, where $Z_{1i}, Z_{2i}\ (i=1,\ldots,n)$ are IID $N(0,1).$ 
This result is related to the Bartlett decomposition of the Wishart matrix \citep{anderson2003introduction} as commented in the Supplementary Materials.


As a byproduct of our proof by representation, we have shown that $ Z_1Z_3 + Z_2Z_4$ follows a Laplace distribution. Because of symmetry $Z_2\sim -Z_2$, the determinant of a two by two matrix with IID $N(0,1)$ entries, $Z_1Z_3 - Z_2Z_4$, also follows a Laplace distribution. This result has been established early in the literature \citep{nyquist1954distribution, nicholson1958distribution}, with a proof similar to our representation by \citet{mantel1966light}, and a proof based on characteristic functions by \citet{mantel1973characteristic}. In a series of exchanges in {\it The American Statistician}, these proofs were revived by \citet{missiakoulis1985distribution}, \citet{farebrother1986pitman} and \citet{mantel1987laplace}. 






Professor Christian P. Robert posted online a proof based on directly calculating the density function. He generously allowed us to include his proof, which is in the Supplementary Materials. In a blog article about Gauss--Laplace transmutation, he was enthusiastic about proofs without complicated integrals or advanced theory, which motivated our note here.










\bibliographystyle{apalike}

2015-10-30T01:12:25.000
1510
1510.08765
en
https://arxiv.org/abs/1510.08765
Under certain conditions, a symmetric unimodal continuous random variable $\xi$ can be represented as a scale mixture of the standard Normal distribution $Z$, i.e., $\xi = \sqrt{W} Z$, where the mixing distribution $W$ is independent of $Z.$ It is well known that if the mixing distribution is inverse Gamma, then $\xi$ is student's $t$ distribution. However, it is less well known that if the mixing distribution is Gamma, then $\xi$ is a Laplace distribution. Several existing proofs of the latter result rely on complex calculus and change of variables in integrals. We offer two simple and intuitive proofs based on representation and moment generating functions.
Statistics Theory (math.ST)
Representation for the Gauss-Laplace Transmutation
Qwen/Qwen-72B
1. YES
2. YES