--- abstract: 'Linear statistics of eigenvalues in many familiar classes of random matrices are known to obey gaussian central limit theorems. The proofs of such results are usually rather difficult, involving hard computations specific to the model in question. In this article we attempt to formulate a unified technique for deriving such results via relatively soft arguments. In the process, we introduce a notion of 'second order Poincaré inequalities': just as ordinary Poincaré inequalities give variance bounds, second order Poincaré inequalities give central limit theorems. The proof of the main result employs Stein's method of normal approximation. A number of examples are worked out, some of which are new. One of the new results is a CLT for the spectrum of gaussian Toeplitz matrices.' address: '367 Evans Hall \#3860Department of StatisticsUniversity of California at BerkeleyBerkeley, CA 94720-3860 ' author: - Sourav Chatterjee title: Fluctuations of eigenvalues and second order Poincaré inequalities --- [^1] Introduction {#intro} ============ Suppose $A_n$ is an $n\times n$ matrix with real or complex entries and eigenvalues $\lambda_1,\ldots,\lambda_n$, repeated by multiplicities. A linear statistic of the eigenvalues of $A_n$ is a function of the form $\sum_{i=1}^n f(\lambda_i)$, where $f$ is some fixed function. Central limit theorems for linear statistics of eigenvalues of large dimensional random matrices have received considerable attention in recent years. A very curious feature that makes these results unusual and interesting is that they usually <span>*do not require normalization*</span>, i.e. one does not have to divide by $\sqrt{n}$; only centering is enough. Moreover, they have important applications in statistics and other applied areas (see e.g. the recent survey by Johnstone @johnstone06). The literature around the topic is quite large. To the best of our knowledge, the investigation of central limit theorems for linear statistics of eigenvalues of large dimensional random matrices began with the work of Jonsson @jonsson82 on Wishart matrices. The key idea is to express $\sum \lambda_i^k$ as $$\sum \lambda_i^k = {\operatorname{Tr}}(A_n^k) = \sum_{i_1,i_2,\ldots,i_k} a_{i_1i_2}a_{i_2i_3}\cdots a_{i_{k-1}i_k}a_{i_ki_1},$$ where $A_n$ is an $n \times n$ Wishart matrix, and then apply the method of moments to show that this is gaussian in the large $n$ limit. In fact, Jonsson proves the joint convergence of the law of $({\operatorname{Tr}}(A_n), {\operatorname{Tr}}(A_n^2),\ldots,{\operatorname{Tr}}(A_n^p))$ to a multivariate normal distribution (where $p$ is fixed). A similar study for Wigner matrices was carried out by Sinaĭ and Soshnikov @sinaisoshnikov98 [@sinaisoshnikov98b]. A deep and difficult aspect of the Sinaĭ-Soshnikov results is that they get central limit theorems for ${\operatorname{Tr}}(A_n^{p_n})$, where $p_n$ is allowed to grow at the rate $o(n^{2/3})$, instead of remaining fixed. They also get CLTs for ${\operatorname{Tr}}(f(A_n))$ for analytic $f$. Incidentally, for gaussian Wigner matrices, the best available results are due to Johansson @johansson98, who characterized a large (but not exhaustive) class of functions for which the CLT holds. In fact, Johansson proved a general result for linear statistics of eigenvalues of random matrices whose entries have a joint density with respect to Lebesgue measure of the form $Z_n^{-1}\exp(-n{\operatorname{Tr}}V(A))$, where $V$ is a polynomial function and $Z_n$ is the normalizing constant. These models are widely studied in the physics literature. Johansson's proof relies on a delicate analysis of the joint density of the eigenvalues, which is explicitly known for this class of matrices. Another important contribution is the work of Diaconis and Evans @diaconisevans01, who proved similar results for random unitary matrices. Again, the basic approach relies on the method of moments, but the computations require new ideas because of the lack of independence between the matrix entries. However, as shown in @diaconisshahshahani94 [@diaconisevans01], strikingly exact computations are possible in this case by invoking some deep connections between symmetric function theory and the unitary group. An alternative approach, based on Stieltjes transforms, has been developed in Bai and Yao @baiyao03 and Bai and Silverstein @baisilverstein04. This approach has its roots in the semi-rigorous works of Girko @girko90 and Khorunzhy, Khoruzhenko, and Pastur @kkp96. Yet another line of attack, via stochastic calculus, was initiated in the work of Cabanal-Duvillard @cabanalduvillard01. The ideas were used by Guionnet @guionnet02 to prove central limit theorems for certain band matrix models. Far reaching results for a very general class of band matrix models were later obtained using combinatorial techniques by Anderson and Zeitouni @andersonzeitouni06a. Other influential ideas, sometimes at varying levels of rigor, come from the papers of Costin and Lebowitz @costinlebowitz95, Boutet de Monvel, Pastur and Shcherbina @boutet95, Johansson @johansson97, Keating and Snaith @keatingsnaith00, Hughes et. al. @hughesetal00, Soshnikov @soshnikov02, Israelson @israelson01 and Wieand @wieand02. The recent works of Anderson and Zeitouni @andersonzeitouni06, Dumitriu and Edelman @dumitriuedelman06, Rider and Silverstein @ridersilverstein06, Rider and Virág @ridervirag06, Jiang @jiang06, and Hachem et. al. @hachem06 [@hachem07] provide several illuminating insights and new results. The recent advances in the theory of second order freeness (introduced by Mingo and Speicher @mingospeicher06) are also of great interest. In this paper we introduce a result (Theorem \[matrix\]) that may provide a unified 'soft tool' for matrices that can be easily expressed as smooth functions of independent random variables. The tool is soft in the sense that we only need to calculate various upper and lower bounds rather than perform exact computations of limits as required for existing methods. (In this context, it should be noted that soft arguments are possible even in the combinatorial techniques, if one works with cumulants instead of moments, e.g. as in @andersonzeitouni06a, Lemma 4.10). We demonstrate the scope of our approach with applications to generalized Wigner matrices, gaussian matrices with arbitrary correlation structure, gaussian Toeplitz matrices, Wishart matrices, and double Wishart matrices. The intuitive idea ------------------ Let us now briefly describe the main idea. Suppose $X = (X_1,\ldots,X_n)$ is a vector of independent standard gaussian random variables, and $g:{\mathbb{R}}^n {\rightarrow}{\mathbb{R}}$ is a smooth function. Let $\nabla g$ denote the gradient of $g$. We know that if $\|\nabla g(X)\|$ is typically small, then $g(X)$ has small fluctuations. In fact, the gaussian Poincaré inequality says that $$\label{poincareineq} {\mathrm{Var}}(g(X)) \le {\mathbb{E}}\|\nabla g(X)\|^2.$$ Thus, the size of $\nabla g$ controls the variance of $g(X)$. Based on this, consider the following speculation: Is it possible to extend the Poincaré inequality to the 'second order', as a method of determining whether $g(X)$ is approximately gaussian by inspecting the behavior of the second order derivatives of $g$? The speculation turns out to be correct (and useful for random matrices), although in a rather mysterious way. The following example is representative of a general phenomenon. Suppose $B$ is a fixed $n \times n$ real symmetric matrix, and the function $g:{\mathbb{R}}^n {\rightarrow}{\mathbb{R}}$ is defined as $$g(x) = x^t Bx,$$ where $x^t$ denotes the transpose of the vector $x$. Let $X = (X_1,\ldots,X_n)$ be a vector of independent standard gaussian random variables, and let us ask the question "When is $g(X)$ approximately gaussian?". Now, if $\lambda_1, \lambda_2, \ldots, \lambda_n$ are the eigenvalues of $B$ with corresponding eigenvectors $u_1,u_2,\ldots,u_n$, then $$g(X) = \sum_{i=1}^n \lambda_i Y_i^2,$$ where $Y_i = u_i^t X$. Since we can assume without loss of generality that $u_1,\ldots,u_n$ are mutually orthogonal, therefore $Y_1,\ldots, Y_n$ are again i.i.d. standard gaussian. This seems to suggest that $g(X)$ is approximately gaussian if and only if 'no eigenvalue dominates in the sum'. In fact, one can show that $g(X)$ is approximately gaussian if and only if $$\max_i |\lambda_i|^2 \ll \sum_i \lambda_i^2.$$ Now $\nabla^2 g (x) \equiv 2B$, where $\nabla^2 g$ denotes the Hessian matrix of $g$. Thus, the question about the gaussianity of $g(X)$ can be reduced to a question about the negligibility of the operator norm squared of $\nabla^2 g(X)$ $( = 2\max |\lambda_i|^2)$ in comparison to the variance of $g(X)$ $( = 2\sum \lambda_i^2)$. In Theorem \[poincare1\] we generalize this notion to show that for any smooth $g$, $g(X)$ is approximately gaussian whenever <span>*the typical size of the operator norm squared of $\nabla^2g(X)$ is small compared to ${\mathrm{Var}}(g(X))$*</span>, and a few other conditions are satisfied. An outline of the rigorous proof is given in the next subsection. The idea is applied to random matrices as follows. We consider random matrices that can be easily expressed as functions of independent random variables, and think of the linear statistics of eigenvalues as functions of these independent variables. The setup can be pictorially represented as $$\text{large vector } X {\rightarrow}\text{ matrix } A(X) {\rightarrow}\text{ linear statistic ${\textstyle\sum_i} f(\lambda_i)$} =: g(X).$$ The main challenge is to evaluate the second order partial derivatives of $g$. However, our task is simplified (and the argument is 'soft') because we only need bounds and not exact computations. Still, a considerable amount of bookkeeping is involved. We provide a 'finished product' in Theorem \[matrix\] for the convenience of potential future users of the method. A discrete version of this idea is investigated in the author's earlier paper @chatterjeenormal1. However, no familiarity with @chatterjeenormal1 is required here. Outline of the proof via Stein's method --------------------------------------- The argument for general $g$ is not as intuitive as for quadratic forms. It begins with Stein's method @stein72 [@stein86]: If a random variable $W$ satisfies ${\mathbb{E}}(\varphi(W)W) \approx {\mathbb{E}}(\varphi'(W))$ for a large class of functions $\varphi$, then $W$ is approximately standard gaussian. The idea stems from the fact that if $W$ is <span>*exactly*</span> standard gaussian, then ${\mathbb{E}}(\varphi(W)W) = {\mathbb{E}}(\varphi'(W))$ for all absolutely continuous $\varphi$ for which both sides are well defined. Stein's lemma (Lemma \[steins\] in this paper) makes this precise with error bounds. Now suppose we are given a random variable $W$, and there is a function $h$ such that for all a.c. $\varphi$, $$\label{hdef} {\mathbb{E}}(\varphi(W)W) = {\mathbb{E}}(\varphi'(W) h(W)).$$ For example, if $W$ has a density $\rho$ with respect to Lebesgue measure, and ${\mathbb{E}}(W) = 0$, ${\mathbb{E}}(W^2) = 1$, then the function $$h(x) = \frac{\int_x^\infty y \rho(y) dy}{\rho(x)}$$ serves the purpose. Now if $h(W) \approx 1$ in a probabilistic sense, then we can conclude that $${\mathbb{E}}(\varphi(W)W) \approx {\mathbb{E}}(\varphi'(W)),$$ and it would follow by Stein's method that $W$ is approximately standard gaussian. This idea already occurs in the literature on normal approximation @cacoullosetal94. However, it is not at all clear how one can infer facts about $h(W)$ when $W$ is an immensely complex object like a linear statistic of eigenvalues of a Wigner matrix. One of the main contributions of this paper is an explicit formula for $h(W)$ when $W$ can be expressed as a differentiable function of a collection of independent gaussian random variables. \[basiclmm\] Suppose $X = (X_1,\ldots,X_n)$ is a vector of independent standard gaussian random variables, and $g:{\mathbb{R}}^n {\rightarrow}{\mathbb{R}}$ is an absolutely continuous function. Let $W = g(X)$, and suppose that ${\mathbb{E}}(W) = 0$ and ${\mathbb{E}}(W^2) = 1$. Suppose $h$ is a function satisfying for all Lipschitz $\varphi$. Then $h(W) = {\mathbb{E}}(T(X)|W)$, where $$T(x) := \int_0^1 \frac{1}{2{\sqrt{t}}} {\mathbb{E}}\biggl(\sum_{i=1}^n {\frac{\partial g}{\partial x_i}}(x) {\frac{\partial g}{\partial x_i}}({\sqrt{t}}x + {\sqrt{1-t}}X) \biggr) dt.$$ Barring the technical details, the proof of this lemma is surprisingly simple. To establish , we only have to show that for all Lipschitz $\varphi$, $${\mathbb{E}}(\varphi(W)W) = {\mathbb{E}}(\varphi'(W) T(X)).$$ This is achieved via gaussian interpolation. Let $X'$ be an independent copy of $X$, and let $W_t = g({\sqrt{t}}X + {\sqrt{1-t}}X')$. Since ${\mathbb{E}}(W) = 0$, we have $$\begin{aligned} {\mathbb{E}}(&\varphi(W)W) = {\mathbb{E}}(\varphi(W)(W_1 - W_0)) = \int_0^1 {\mathbb{E}}\biggl(\varphi(W) \frac{\partial W_t}{\partial t}\biggr) dt\\ &= {\mathbb{E}}\biggl(\int_0^1 \varphi(W) \sum_{i=1}^n \biggl(\frac{X_i}{2{\sqrt{t}}} - \frac{X'_i}{2{\sqrt{1-t}}}\biggr){\frac{\partial g}{\partial x_i}}({\sqrt{t}}X + {\sqrt{1-t}}X') dt\biggr).\end{aligned}$$ Integration by parts on the right hand side gives the desired result. The details of the proof are contained in the proof of the more elaborate Lemma \[gaussian\] in Section \[proofs\]. Since ${\mathbb{E}}(W^2) = 1$, taking $\varphi(x) = x$ it follows that ${\mathbb{E}}(h(W)) = 1$. Combining this with the fact that ${\mathrm{Var}}(h(W)) \le {\mathrm{Var}}(T(X))$, we see that we only have to bound ${\mathrm{Var}}(T(X))$ to show that $W$ is approximately gaussian. Now, if $g$ is a complicated function, $T$ is even more complicated. Hence, we cannot expect to evaluate ${\mathrm{Var}}(T(X))$. On the other hand, we can always use the gaussian Poincaré inequality to compute a bound on ${\mathrm{Var}}(T(X))$. This involves working with $\nabla T$. Since $T$ already involves the first order derivatives of $g$, $\nabla T$ brings the second order derivatives into the picture. This is how we relate the smallness of the Hessian of $g$ to the approximate gaussianity of $g(X)$, leading to Theorem \[poincare1\] in the next section. We should mention here that a problem with Lemma \[basiclmm\] is that we have to know how to center and scale $W$ so that ${\mathbb{E}}(W) = 0$ and ${\mathbb{E}}(W^2) =1$. This may not be easy in practice. It is also worth noting that Lemma \[basiclmm\] can, in fact, be used to prove the gaussian Poincaré inequality — just by taking $\varphi(x) = x$ and applying the Cauchy-Schwarz inequality to bound the terms inside the integral in the expression for ${\mathbb{E}}(T)$. In this sense, one can view Lemma \[basiclmm\] as a generalization of the gaussian Poincaré inequality. Incidentally, the first proof of the gaussian Poincaré inequality in the probability literature is due to H. Chernoff @chernoff81 who used Hermite polynomial expansions. However, such inequalities have been known to analysts for a long time under the name of 'Hardy inequalities with weights' (see e.g. Muckenhoupt @muckenhoupt72). We should also mention two other concepts from the existing literature that may be related to this work. The first is the notion of the 'zerobias transform' of $W$, as defined by Goldstein and Reinert @goldsteinreinert97. A random variable $W^*$ is called a zerobias transform of $W$ if for all $\varphi$, we have $${\mathbb{E}}(\varphi(W)W) = {\mathbb{E}}(\varphi'(W^*)).$$ A little consideration shows that our function $h$ is just the density of the law of $W^*$ with respect to the law of $W$ when the laws are absolutely continuous with respect to each other. However, while it is quite difficult to construct zerobias transforms (not known at present for linear statistics of eigenvalues), Lemma \[basiclmm\] gives a direct formula for $h$. The second related idea is the work of Borovkov and Utev @borovkovutev83 which says that if a random variable $W$ with ${\mathbb{E}}(W) = 0$ and ${\mathbb{E}}(W^2) = 1$ satisfies a Poincaré inequality with Poincaré constant close to $1$, then $W$ is approximately standard gaussian (if the Poincaré constant is exactly $1$, the $W$ is exactly standard gaussian). As shown by Chen @chen88, this fact can be used to prove central limit theorems in ways that are closely related to Stein's method. Although it seems plausible, we could not detect any apparent relationship between this concept and our method of extending Poincaré inequalities to the second order. Second order Poincaré inequalities {#general} ================================== All our results are for functions of random variables belonging to the following class of distributions. For each $c_1,c_2 > 0$, let ${\mathcal{L}}(c_1, c_2)$ be the class of probability measures on ${\mathbb{R}}$ that arise as laws random variables like $u(Z)$, where $Z$ is a standard gaussian r.v. and $u$ is a twice continuously differentiable function such that for all $x\in {\mathbb{R}}$ $$|u'(x)|\le c_1 \ \text{and} \ |u''(x)|\le c_2.$$ For example, the standard gaussian law is in ${\mathcal{L}}(1,0)$. Again, taking $u = $ the gaussian cumulative distribution function, we see that the uniform distribution on the unit interval is in ${\mathcal{L}}((2\pi)^{-1/2}, (2\pi e)^{-1/2})$. For simplicity, we just say that a random variable $X$ is "in ${\mathcal{L}}(c_1,c_2)$" instead of the more elaborate statement that "the distribution of $X$ belongs to ${\mathcal{L}}(c_1,c_2)$". Recall that for any two random variables $X$ and $Y$, the supremum of $|{\mathbb{P}}(X\in B) - {\mathbb{P}}(Y\in B)|$ as $B$ ranges over all Borel sets is called the total variation distance between the laws of $X$ and $Y$, often denoted simply by $d_{TV}(X,Y)$. Note that the total variation distance remains unchanged under any transformation like $(X,Y) {\rightarrow}(f(X),f(Y))$ where $f$ is a measurable bijective map. Next, recall that the operator norm of an $m\times n$ real or complex matrix $A$ is defined as $$\|A\| := \sup\{\|Ax\|: x\in {\mathbb{C}}^n, \|x\|=1\}.$$ Recall that $\|A\|^2$ is the largest eigenvalue of $A^*A$. If $A$ is a hermitian matrix, $\|A\|$ is just the spectral radius (i.e. the eigenvalue with the largest absolute value) of $A$. This is the default norm for matrices in this paper, although occasionally we use the Hilbert-Schmidt norm $$\|A\|_{HS} := \bigl(\sum_{i,j} |a_{ij}|^2\bigr)^{1/2}.$$ The following theorem gives normal approximation bounds for general smooth functions of independent random variables whose laws are in ${\mathcal{L}}(c_1,c_2)$ for some finite $c_1, c_2$. \[poincare1\] Let $X = (X_1,\ldots,X_n)$ be a vector of independent random variables in ${\mathcal{L}}(c_1,c_2)$ for some finite $c_1,c_2$. Take any $g\in C^2({\mathbb{R}}^n) $ and let $\nabla g$ and $\nabla^2 g$ denote the gradient and Hessian of $g$. Let $$\begin{aligned} \kappa_0 &= \biggl({\mathbb{E}}\sum_{i=1}^n \biggl|{\frac{\partial g}{\partial x_i}}(X)\biggr|^4\biggr)^{1/2},\\ \kappa_1 &= ({\mathbb{E}}\|\nabla g(X)\|^4)^{1/4}, \text{ and}\\ \kappa_2 &= ({\mathbb{E}}\|\nabla^2 g(X)\|^4)^{1/4}.\end{aligned}$$ Suppose $W=g(X)$ has a finite fourth moment and let $\sigma^2 = {\mathrm{Var}}(W)$. Let $Z$ be a normal random variable having the same mean and variance as $W$. Then $$d_{TV}(W,Z) \le \frac{2\sqrt{5}(c_1c_2 \kappa_0 + c_1^3\kappa_1\kappa_2)}{\sigma^2}.$$ If we slightly change the setup by assuming that $X$ is a gaussian random vector with mean $0$ and covariance matrix $\Sigma$, keeping all other notation the same, then the corresponding bound is $$d_{TV}(W,Z) \le \frac{2\sqrt{5} \|\Sigma\|^{3/2} \kappa_1\kappa_2}{\sigma^2}.$$ Note that when $X_1,\ldots,X_n$ are gaussian, we have $c_2 = 0$, and the first bound becomes simpler. For an elementary illustrative application of Theorem \[poincare1\], consider the function $$g(x) = \frac{1}{\sqrt{n}}\sum_{i=1}^{n-1} x_ix_{i+1}.$$ Then $${\frac{\partial g}{\partial x_i}} = \frac{x_{i-1} + x_{i+1}}{\sqrt{n}},$$ with the convention that $x_0 \equiv x_{n+1} \equiv 0$. Again, $${\frac{\partial^2 g}{\partial x_i \partial x_j}} = \begin{cases} 1/\sqrt{n} &\text{ if } |i-j| = 1,\\ 0 &\text{ otherwise.} \end{cases}$$ It follows that $\kappa_0 = O(1/\sqrt{n})$, $\kappa_1 = O(1)$, and $\kappa_2 = O(1/\sqrt{n})$, which gives a total variation error bound of order $1/\sqrt{n}$. Note that the usual way to prove a CLT for $n^{-1/2}\sum_{i=1}^{n-1}X_i X_{i+1}$ is via martingale arguments, but total variation bounds are not trivial to obtain along that route. .1in <span>*Remarks.*</span> (i) Theorem \[poincare1\] can be viewed as a second order analog of the gaussian Poincaré inequality . While the Poincaré inequality implies that $g(X)$ is concentrated whenever the individual coordinates have small 'influence' on the outcome, Theorem \[poincare1\] says that if in addition, the 'interaction' between the coordinates is small, then $g(X)$ has gaussian behavior. The magnitude of $\|\nabla^2 g(X)\|$ is a measure of this interaction. (ii) The smallness of $\|\nabla^2 g(X)\|$ does not seem to imply that $g(X)$ has any special structure, at least from what the author understands. In particular, it does not imply that $g(X)$ breaks up as an approximately additive function as in Hájek projections @vanzwet84 [@friedrich89]. It is quite mysterious, at the present level of understanding, as to what causes the gaussianity. (iii) A problem with Theorem \[poincare1\] is that it does not say anything about $\sigma^2$. However, in practice, we only need to know a lower bound on $\sigma^2$ to use Theorem \[poincare1\] for proving a CLT. Sometimes this may be a lot easier to achieve than computing the exact limiting value of $\sigma^2$. This is demonstrated in some of our examples in Section \[examples\]. (iv) One may wonder why we work with random variables in ${\mathcal{L}}(c_1,c_2)$ instead of just gaussian random variables. Indeed, the main purpose of this limited generality is simply to pre-empt the question 'Does your result extend to the non-gaussian case?'. However, it is more serious than that: The true rate of convergence may actually differ significantly depending on whether $X$ is gaussian or not, as demonstrated in the case of Wigner matrices in Section \[examples\]. (v) There is a substantial body of literature on central limit theorems for general functions of independent random variables. Some examples of available techniques are: (a) the classical method of moments, (b) the martingale approach and Skorokhod embeddings, (c) the method of Hajék projections and some sophisticated extensions (e.g. @vanzwet84, @ruschendorf85, @friedrich89), (d) Stein's method of normal approximation (e.g. @stein72, @stein86, @goldsteinreinert97), and (e) the big-blocks-small-blocks technique and its modern multidimensional versions (e.g. @bickelbreiman83, @avrambertsimas93). For further references — particularly on Stein's method, which is a cornerstone of our approach — we refer to @chatterjeenormal1. Apart from the method of moments, none of the other techniques have been used for dealing with random matrix problems. The random matrix result {#generalclt} ======================== Let $n$ be a fixed positive integer and ${\mathcal{I}}$ be a finite indexing set. Suppose that for each $1\le i,j\le n$, we have a $C^2$ map $a_{ij}: {\mathbb{R}}^{{\mathcal{I}}} {\rightarrow}{\mathbb{C}}$. For each $x\in {\mathbb{R}}^{\mathcal{I}}$, let $A(x)$ be the complex $n\times n$ matrix whose $(i,j)^{\mathrm{th}}$ element is $a_{ij}(x)$. Let $$f(z) = \sum_{m=0}^\infty b_m z^m$$ be an analytic function on the complex plane. Let $X=(X_u)_{u\in{\mathcal{I}}}$ be a collection of independent random variables in ${\mathcal{L}}(c_1,c_2)$ for some finite $c_1,c_2$. Under this very general setup, we give an explicit bound on the total variation distance between the laws of ${\operatorname{Re}}{\operatorname{Tr}}f(A(X))$ and a gaussian random variable with matching mean and variance (here as usual, ${\operatorname{Re}}z$ and ${\operatorname{Im}}z$ denote the real and imaginary parts of a complex number $z$). As mentioned before, the method involves some bookkeeping, partly due to the quest for generality. The algorithm requires the user to compute a few quantities associated with the matrix model, step by step as described below. First, let $$\label{rs} \begin{split} \mathcal{R} &= \{\alpha\in {\mathbb{C}}^{\mathcal{I}}: {\textstyle\sum_{u\in {\mathcal{I}}}} |\alpha_u|^2 = 1\} \ \text{ and } \\ \mathcal{S} &= \{\beta\in {\mathbb{C}}^{n\times n} : {\textstyle \sum_{i,j=1}^n} |\beta_{ij}|^2 =1 \}. \end{split}$$ Next, define three functions $\gamma_0$, $\gamma_1$ and $\gamma_2$ on ${\mathbb{R}}^{\mathcal{I}}$ as follows. $$\label{gamma} \begin{split} \gamma_0(x) &:= \sup_{u\in {\mathcal{I}}, \|B\|=1} \biggl|{\operatorname{Tr}}\biggl(B{\frac{\partial A}{\partial x_u}}\biggr)\biggr|,\\ \gamma_1(x) &:= \sup_{\alpha\in \mathcal{R}, \beta \in \mathcal{S}}\biggl|\sum_{u\in {\mathcal{I}}}\sum_{i,j=1}^n \alpha_u\beta_{ij}{\frac{\partial a_{ij}}{\partial x_u}}\biggr|, \text{ and }\\ \gamma_2(x) &:= \sup_{\alpha, \alpha'\in \mathcal{R},\beta \in \mathcal{S}}\biggl|\sum_{u,v\in {\mathcal{I}}} \sum_{i,j=1}^n \alpha_u\alpha_v'\beta_{ij}{\frac{\partial^2 a_{ij}}{\partial x_u \partial x_v}}\biggr|. \end{split}$$ Define two entire functions $f_1$ and $f_2$ as $$f_1(z)=\sum_{m=1}^\infty m |b_m|z^{m-1} \ \text{ and } \ f_2(z) = \sum_{m=2}^\infty m(m-1)|b_m| z^{m-2}.$$ Let $\lambda(x) = \|A(x)\|$ and $r(x) = \mathrm{rank}(A(x))$. Usually, of course, we will just have $r(x)\equiv n$. Next, define three more functions $$\begin{aligned} \eta_0(x) &= \gamma_0(x) f_1(\lambda(x)), \\ \eta_1(x) &= \gamma_1(x) f_1(\lambda(x)) \sqrt{r(x)}, \text{ and}\\ \eta_2(x) &= \gamma_2(x)f_1(\lambda(x)) \sqrt{r(x)} + \gamma_1(x)^2 f_2(\lambda(x)).\end{aligned}$$ Finally, define three quantities $\kappa_0$, $\kappa_1$, and $\kappa_2$ as $$\begin{aligned} \kappa_0 &= ({\mathbb{E}}(\eta_0(X)^2\eta_1(X)^2))^{1/2}, \\ \kappa_1 &= ({\mathbb{E}}\eta_1(X)^4)^{1/4}, \ \text{ and } \\ \kappa_2 &= ({\mathbb{E}}\eta_2(X)^4)^{1/4}.\end{aligned}$$ Let us pacify the possibly disturbed reader with the assurance that we only need <span>*bounds*</span> on $\kappa_0$, $\kappa_1$, and $\kappa_2$, as oppposed to exact computations. This turns out to be particularly easy to achieve in all our examples. We are now ready to state the theorem. \[matrix\] Let all notation be as above. Suppose $W= {\operatorname{Re}}{\operatorname{Tr}}f(A(X))$ has finite fourth moment and let $\sigma^2 = {\mathrm{Var}}(W)$. Let $Z$ be a normal random variable with the same mean and variance as $W$. Then $$d_{TV}(W,Z) \le \frac{2\sqrt{5} (c_1c_2 \kappa_0 + c_1^3 \kappa_1\kappa_2)}{\sigma^2}.$$ If we slightly change the setup by assuming that $X$ is a gaussian random vector with mean $0$ and covariance matrix $\Sigma$, keeping all other notation the same, then the corresponding bound is $$d_{TV}(W,Z) \le \frac{2\sqrt{5} \|\Sigma\|^{3/2} \kappa_1\kappa_2}{\sigma^2}.$$ <span>*Remarks.*</span> (i) A problem with Theorem \[matrix\] is that it does not give a formula or approximation for $\sigma^2$. However, central limit theorems can still be proven if we can only compute suitable <span>*lower bounds*</span> for $\sigma^2$. In Section \[examples\], we show that this is eminently possible in a variety of situations (e.g. Theorems \[wignerthm\] and \[toeplitz\]). (ii) Although the result is stated for entire functions, the concrete error bound, combined with appropriate concentration inequalities, should make it possible to prove limit theorems for general $C^1$ functions wherever required. (iii) Note that the matrices need not be hermitian, and the random variables need not be symmetric around zero. However, it is a significant restriction that the $X_{ij}$'s have to belong to ${\mathcal{L}}(c_1,c_2)$ for some finite $c_1,c_2$. In particular, they cannot be discrete. (iv) By considering $\alpha f$ instead of $f$ for arbitrary $\alpha \in {\mathbb{C}}$, we see that the normal approximation error bound can be computed for any linear combination of the real and imaginary parts of the trace. This allows us to prove central limit theorems for the complex statistic ${\operatorname{Tr}}f(A)$ via Wold's device. (v) It is somewhat surprising that such a general result can give useful error bounds for familiar random matrix models. Unfortunately, the case of random unitary and orthogonal matrices seems to be harder because of the complexity in expressing them as functions of independent random variables. This is under the scope of a future project. Applications {#examples} ============ This section is devoted to working out a number of applications of Theorem \[poincare1\]. In all cases, we produce a total variation error bound where the variance of the linear statistic, $\sigma^2$, appears as an unknown quantity. In some of the examples (e.g. Wigner and Wishart matrices), the limiting value of $\sigma^2$ is known from the literature. In other cases, they are yet unknown, and the central limit theorems are proven modulo this lack of knowledge about $\sigma^2$. The following simple lemma turns out to be very useful for bounding $\gamma_0$, $\gamma_1$, and $\gamma_2$ in the examples. Recall the definitions of the operator norm and the Hilbert-Schmidt norm of matrices from Section \[general\]. \[trivial\] Suppose $A_1,\ldots,A_n$ $(n \ge 3)$ are real or complex matrices of dimensions such that the product $A_1A_2\cdots A_n$ is defined. Then $$\label{normprop} \|A_1A_2\|_{HS}\le \min\{\|A_1\|\|A_2\|_{HS}, \|A_1\|_{HS}\|A_2\|\}.$$ Moreover, for any $1\le i< j\le n$, $$|{\operatorname{Tr}}(A_1A_2\cdots A_n)| \le \|A_i\|_{HS}\|A_j\|_{HS} \prod_{k\in [n]\backslash\{i,j\}} \|A_k\|.$$ Let $b_1,\ldots, b_n$ be the columns of $A_2$. Then $$\begin{aligned} \|A_1A_2\|_{HS}^2 &= {\operatorname{Tr}}(A_2^*A_1^*A_1A_2) = \sum_{i=1}^n \|A_1b_i\|^2 \\ &\le \|A_1\|^2\sum_{i=1}^n\|b_i\|^2 = \|A_1\|^2 \|A_2\|^2_{HS}.\end{aligned}$$ Similarly, we have $\|A_1A_2\| \le \|A_1\|_{HS}\|A_2\|$. For the other inequality, note that a simple application of the Cauchy-Schwarz inequality shows that $$|{\operatorname{Tr}}(A_1A_2\cdots A_n)| \le \|A_1\cdots A_i\|_{HS}\|A_{i+1}\cdots A_n\|_{HS}$$ Now by the inequality , $$\|A_1\cdots A_i\|_{HS} \le \|A_1\cdots A_{i-1}\| \|A_i\|_{HS}.$$ Similarly, $$\begin{aligned} \|A_{i+1}\cdots A_n\|_{HS} &\le \|A_{i+1}\cdots A_{j-1}\| \|A_j \cdots A_n\|_{HS}\\ &\le \|A_{i+1}\cdots A_{j-1}\| \|A_j\|_{HS}\|A_{j+1} \cdots A_n\|.\end{aligned}$$ This completes the proof. Generalized Wigner matrices --------------------------- Suppose $X = (X_{ij})_{1\le i \le j\le n}$ is a collection of independent random variables. Let $X_{ij} = X_{ji}$ for $i>j$ and let $$\label{wignermatrix} A_n = A_n(X) := \frac{1}{\sqrt{n}}(X_{ij})_{1\le i,j\le n}.$$ A matrix like $A_n$ is called a Wigner matrix. Central limit theorems for linear statistics of eigenvalues of Wigner matrices have been extensively studied in the literature (see e.g. @sinaisoshnikov98 [@sinaisoshnikov98b; @soshnikov02; @andersonzeitouni06a]). While the case of gaussian entries can be dealt with using analytical techniques @johansson98, the general case requires heavy combinatorics. To give a flavor of the results in the literature, let us state one key theorem from @sinaisoshnikov98b (although, technically, it is not a CLT for a fixed linear statistic). .1in <span>**Theorem.**</span> (Sinaĭand Soshnikov @sinaisoshnikov98b, Theorem 2) <span>*Let $X_{ij}$ and $A_n$ be as above. Suppose that the $X_{ij}$'s have symmetric distributions around zero, ${\mathbb{E}}(X_{ij}^2) = 1/4$ for all $i,j$, and there exists a constant $K$ such that for every positive integer $m$ and all $i,j$, ${\mathbb{E}}(X_{ij}^{2m})\le (Km)^m$. Let $p_n {\rightarrow}\infty$ as $n{\rightarrow}\infty$ such that $p_n = o(n^{2/3})$. Then*</span> $${\mathbb{E}}({\operatorname{Tr}}A_n^{p_n}) = \begin{cases} 2^{3/2} n(\pi p_n^3)^{-1/2} (1+ o(1)) & \text{\it if $p_n$ is even,}\\ 0 & \text{\it if $p_n$ is odd,} \end{cases}$$ <span>*and the distribution of ${\operatorname{Tr}}A_n^{p_n} - {\mathbb{E}}({\operatorname{Tr}}A_n^{p_n})$ converges weakly to the normal law $N(0,1/\pi)$.* </span> .1in As remarked in @sinaisoshnikov98b and demonstrated in @sinaisoshnikov98, the normal approximation result can be extended to the joint distribution of the traces of various powers, and then to general analytic functions. We wish to extend the above result to the scenario where ${\mathbb{E}}(X_{ij}^2)$ is not the same for all $i,j$. A wide generalization of this problem has been recently investigated by Anderson and Zeitouni @andersonzeitouni06a under the assumption that ${\mathbb{E}}(X_{ij}^2) \sim f(\frac{i}{n}, \frac{j}{n})$ where $f$ is a continuous function on $[0,1]^2$. Under further assumptions, explicit formulas for the limiting means and variances are also obtained in @andersonzeitouni06a. If the structural assumptions are dropped and we just assume that ${\mathbb{E}}(X_{ij}^2)$ is bounded above and below by positive constants, then there does not seem to be much hope of getting limiting formulas. Surprisingly, however, Theorem \[matrix\] still allows us to prove central limit theorems. \[wignerthm\] Let $A_n$ be the Wigner matrix defined in . Suppose that the $X_{ij}$'s are all in ${\mathcal{L}}(c_1,c_2)$ for some finite $c_1, c_2$, and have symmetric distributions around zero. Suppose there are two positive constants $c$ and $C$ such that $c \le {\mathbb{E}}(X_{ij}^2)\le C$ for all $i,j$. Let $p_n$ be a sequence of positive integers such that $p_n = o(\log n)$. Let $W_n = {\operatorname{Tr}}(A_n^{p_n})$. Then as $n {\rightarrow}\infty$, $$\frac{W_n - {\mathbb{E}}(W_n)}{\sqrt{{\mathrm{Var}}(W_n)}} \ \text{ converges in total variation to } \ N(0,1).$$ Moreover, ${\mathrm{Var}}(W_n)$ stays bounded away from zero. The same results are true also if $W_n = {\operatorname{Tr}}f(A_n)$, where $f$ is a fixed nonzero polynomial with nonnegative coefficients. Note that the rate of growth allowed for $p_n$ is $o(\log n)$, which is significantly worse than the Sinaĭ-Soshnikov condition $p_n = o(n^{2/3})$. We do not know how to improve omiller@example.org. Neither do we know how to produce asymptotic formulas for ${\mathbb{E}}(W_n)$ and ${\mathrm{Var}}(W_n)$ as in Anderson and Zeitouni @andersonzeitouni06a. On the positive side, the assumption that $c\le {\mathbb{E}}(X_{ij}^2) \le C$ is more general than any available result, as far as we know. In particular, we do not require asymptotic 'continuity' of ${\mathbb{E}}(X_{ij}^2)$ in $(i,j)$. The proof of Theorem \[wignerthm\] will follow from the following finite sample error bound. \[wigner\] Fix $n$. Let $A = A(X)$ be the Wigner matrix defined in . Suppose the $X_{ij}$'s are in ${\mathcal{L}}(c_1,c_2)$ for some finite $c_1,c_2$. Take an entire function $f$ and define $f_1$, $f_2$ as in Theorem \[matrix\]. Let $\lambda$ denote the spectral radius of $A$. Let $a = ({\mathbb{E}}f_1(\lambda)^4)^{1/4}$ and $b = ({\mathbb{E}}f_2(\lambda)^4)^{1/4}$. Suppose $W= {\operatorname{Re}}{\operatorname{Tr}}f(A)$ has finite fourth moment and let $\sigma^2 = {\mathrm{Var}}(W)$. Let $Z$ be a normal random variable with the same mean and variance as $W$. Then $$d_{TV}(W, Z) \le \frac{2\sqrt{5}}{\sigma^2}\biggl(\frac{4c_1 c_2 a^2}{\sqrt{n}} + \frac{8c_1^3 ab}{n}\biggr).$$ <span>*Remarks.*</span> (i) It is well known that under mild conditions, $\lambda$ converges to a finite limit as $n {\rightarrow}\infty$ (see e.g. @bai99, Section 2.2.1). Even exponentially decaying tail bounds are available @gz00. Thus $a$ and $b$ are generally $O(1)$ in the above bound. (ii) Sinaĭand Soshnikov (@sinaisoshnikov98, Corollary 1) showed that $\sigma^2$ converges to a finite limit under certain conditions on $f$ and the distribution of the $X_{ij}$'s. If these conditions are satisfied and the limit is nonzero, then we get a bound of order $1/\sqrt{n}$. Moreover, for gaussian Wigner matrices we have $c_2 = 0$ and hence a bound of order $1/n$. The difference between the gaussian and non-gaussian cases is not an accident. With $f(z) = z$, we have $${\operatorname{Tr}}f(A) = \frac{1}{\sqrt{n}}\sum_{i=1}^n X_{ii}.$$ In this case we know that the error bound in the non-gaussian case is exactly of order $1/\sqrt{n}$. .1in Before proving Lemma \[wigner\], let us first prove Theorem \[wignerthm\] using the lemma. The main difference between Lemma \[wigner\] and Theorem \[wignerthm\] is that the assumption of symmetry on the distributions of the entries allows us to compute a lower bound on the unknown quantity $\sigma^2$ and actually prove a CLT in Theorem \[wignerthm\]. \[Proof of Theorem \[wignerthm\]\] Let $s_{ij}^2 = {\mathbb{E}}(X_{ij}^2)$, and let $$\xi_{ij} = \frac{X_{ij}}{s_{ij}}.$$ Let $\Xi_n$ denote the matrix $\frac{1}{\sqrt{n}}(\xi_{ij})_{1\le i,j\le n}$. Now take any collections of nonnegative integers $(\alpha_{ij})_{1\le i\le j\le n}$ and $(\beta_{ij})_{1\le i\le j\le n}$. Then $$\begin{aligned} &{\mathrm{Cov}}\biggl(\prod X_{ij}^{\alpha_{ij}}, \prod X_{ij}^{\beta_{ij}}\biggr) \\ &= \biggl(\prod s_{ij}^{\alpha_{ij} + \beta_{ij}}\biggr) \biggl(\prod {\mathbb{E}}(\xi_{ij}^{\alpha_{ij} + \beta_{ij}}) - \prod {\mathbb{E}}(\xi_{ij}^{\alpha_{ij}}) {\mathbb{E}}(\xi_{ij}^{\beta_{ij}})\biggr),\end{aligned}$$ where the products are taken over $1\le i\le j\le n$. Now note that if $\alpha_{ij} + \beta_{ij}$ is odd, then ${\mathbb{E}}(\xi_{ij}^{\alpha_{ij} + \beta_{ij}}) = {\mathbb{E}}(\xi_{ij}^{\alpha_{ij}}) {\mathbb{E}}(\xi_{ij}^{\beta_{ij}}) = 0$. If $\alpha_{ij}$ and $\beta_{ij}$ are both odd, then ${\mathbb{E}}(\xi_{ij}^{\alpha_{ij} + \beta_{ij}}) \ge 0$ and ${\mathbb{E}}(\xi_{ij}^{\alpha_{ij}}) = {\mathbb{E}}(\xi_{ij}^{\beta_{ij}}) = 0$. Finally, if $\alpha_{ij}$ and $\beta_{ij}$ are both even, then $${\mathbb{E}}(\xi_{ij}^{\alpha_{ij}}) {\mathbb{E}}(\xi_{ij}^{\beta_{ij}}) \le ({\mathbb{E}}(\xi_{ij}^{\alpha_{ij} + \beta_{ij}}))^{\frac{\alpha_{ij}}{\alpha_{ij} + \beta_{ij}}} ({\mathbb{E}}(\xi_{ij}^{\alpha_{ij} + \beta_{ij}}))^{\frac{\beta_{ij}}{\alpha_{ij} + \beta_{ij}}} = {\mathbb{E}}(\xi_{ij}^{\alpha_{ij} + \beta_{ij}}).$$ Thus, under all circumstances, we have $$\label{covnonneg} {\mathbb{E}}(\xi_{ij}^{\alpha_{ij} + \beta_{ij}}) \ge {\mathbb{E}}(\xi_{ij}^{\alpha_{ij}}) {\mathbb{E}}(\xi_{ij}^{\beta_{ij}}) \ge 0.$$ Therefore, $${\mathrm{Cov}}\biggl(\prod X_{ij}^{\alpha_{ij}}, \prod X_{ij}^{\beta_{ij}}\biggr) \ge c^{\frac{1}{2}\sum(\alpha_{ij}+\beta_{ij})} {\mathrm{Cov}}\biggl(\prod \xi_{ij}^{\alpha_{ij}}, \prod \xi_{ij}^{\beta_{ij}}\biggr).$$ From this, it follows easily that for any positive integer $p_n$, $${\mathrm{Var}}({\operatorname{Tr}}A_n^{p_n}) \ge c^{p_n} {\mathrm{Var}}({\operatorname{Tr}}\Xi_n^{p_n}).$$ Now, by , $${\mathrm{Var}}({\operatorname{Tr}}\Xi_n^{p_n}) \ge \frac{1}{n^{p_n}} \sum_{1\le i_1,\ldots,i_{p_n}\le n} {\mathrm{Var}}(\xi_{i_1i_2}\xi_{i_2i_3}\cdots \xi_{i_{p_n}i_1}).$$ If $i_1,\ldots,i_{p_n}$ are distinct numbers, then $${\mathrm{Var}}(\xi_{i_1i_2}\xi_{i_2i_3}\cdots \xi_{i_{p_n}i_1}) = {\mathbb{E}}(\xi_{i_1i_2}^2){\mathbb{E}}(\xi_{i_2i_3}^2)\cdots {\mathbb{E}}(\xi_{i_{p_n}i_1}^2) = 1.$$ Thus, $${\mathrm{Var}}({\operatorname{Tr}}\Xi_n^{p_n}) \ge \frac{n(n-1)\cdots(n-p_n+1)}{n^{p_n}},$$ and so, if $p_n$ is a sequence of integers such that $p_n = o(n^{1/2})$, then $$\label{varlower} {\mathrm{Var}}({\operatorname{Tr}}A_n^{p_n}) \ge K c^{p_n},$$ where $K$ is a positive constant that does not vary with $n$. Now note that for any nonnegative integer $\alpha_{ij}$, ${\mathbb{E}}(\xi_{ij}^{\alpha_{ij}}) \ge 0$. Thus, $${\mathbb{E}}\biggl(\prod X_{ij}^{\alpha_{ij}}\biggr) = \prod s_{ij}^{\alpha_{ij}} {\mathbb{E}}(\xi_{ij}^{\alpha_{ij}}) \le C^{\frac{1}{2}\sum\alpha_{ij}} {\mathbb{E}}\biggl(\prod \xi_{ij}^{\alpha_{ij}}\biggr).$$ In particular, for any positive integer $l$, $${\mathbb{E}}( {\operatorname{Tr}}A^{l}) \le C^{l/2} {\mathbb{E}}({\operatorname{Tr}}\Xi_n^{l}).$$ Let $\lambda_n$ denote the spectral radius of $A_n$. Then for any positive integer $m$ and any positive even integer $l$, $$\begin{aligned} {\mathbb{E}}(\lambda_n^{m}) &\le \bigl({\mathbb{E}}({\operatorname{Tr}}A_n^{lm})\bigr)^{1/l} \le C^{m/2}\bigl({\mathbb{E}}({\operatorname{Tr}}\Xi_n^{lm})\bigr)^{1/l}.\end{aligned}$$ Now let $l = l_n := 2[\log n]$. If $m_n$ is a sequence of positive integers such that $m_n = o(n^{2/3}/\log n)$, it follows from the Sinaĭ-Soshnikov result stated above that for all $n$, $$\bigl({\mathbb{E}}({\operatorname{Tr}}\Xi_n^{l_nm_n})\bigr)^{1/l_n} \le K' 2^{m_n}n^{1/l_n} \le K 2^{m_n},$$ where $K'$ and $K$ are constants that do not depend on $n$. Note that we could apply the theorem because $\xi_{ij}$'s are symmetric and ${\mathbb{E}}(\xi_{ij}^{2m}) \le (Km)^m$ for all $m$ due to the ${\mathcal{L}}(c_1,c_2)$ assumption. The $2^{m_n}$ term arises because ${\mathbb{E}}(\xi_{ij}^2) = 1$ instead of $1/4$ as required in the Sinaĭ-Soshnikov theorem. Combined with the previous step, this gives $$\label{lambdabd} {\mathbb{E}}(\lambda_n^{m_n}) \le K (4C)^{m_n/2}.$$ Now let us apply Lemma \[wigner\] to $W = {\operatorname{Tr}}A_n^{p_n}$. First, let us fix $n$. We have $f(x) = x^{p_n}$, and hence $f_1(x) = p_n x^{p_n - 1}$ and $f_2(x) = p_n(p_n - 1)x^{p_n - 2}$. It follows that both $a^2$ and $ab$ are bounded by $p_n^2 ({\mathbb{E}}(\lambda_n^{4p_n}))^{1/2}$, which according to , is bounded by $Kp_n^2 (4C)^{p_n}$. On the other hand, by , $\sigma^2$ is lower bounded by $K c^{p_n}$. Combining, and using Lemma \[wigner\], we get $$d_{TV}(W,Z) \le \frac{Kp_n^2}{\sqrt{n}} \biggl(\frac{4C}{c}\biggr)^{p_n},$$ where $K$ is a constant depending only on $c$, $C$, $c_1$ and $c_2$, and $Z$ is a gaussian random variable with the same mean and variance as $W$. If $p_n = o(\log n)$, the bound goes to zero. When $W_n = {\operatorname{Tr}}f(A_n)$, where $f$ is a fixed polynomial with nonnegative coefficients, the proof goes through almost verbatim, and is in fact simpler. The nonnegativity of the coefficients is required to ensure that all monomial terms are positively correlated, so that we can get a lower bound on the variance. \[Proof of Lemma \[wigner\]\] Let ${\mathcal{I}}= \{(i,j):1\le i\le j\le n\}$. Let $x = (x_{ij})_{1\le i\le j\le n}$ denote a typical element of ${\mathbb{R}}^{\mathcal{I}}$. For each such $x$, let $A(x) = (a_{ij}(x))_{1\le i,j\le n}$ denote the matrix whose $(i,j)^{\mathrm{th}}$ element is $n^{-1/2}x_{ij}$ if $i\le j$ and $n^{-1/2}x_{ji}$ if $i >j$. Then the matrix $A$ considered above is simply $A(X)$, and this puts us in the setting of Theorem \[matrix\]. Now, $${\frac{\partial a_{ij}}{\partial x_{kl}}} = \begin{cases} n^{-1/2} &\text{ if } (i,j)=(k,l) \text{ or } (i,j) = (l,k), \\ 0 &\text{ otherwise.} \end{cases}$$ Therefore, for any matrix $B$ with $\|B\|=1$, and $1\le k\ne l\le n$, $$\biggl|{\operatorname{Tr}}\biggl(B{\frac{\partial A}{\partial x_{kl}}}\biggr)\biggr| = \biggl|\frac{b_{kl} + b_{lk}}{\sqrt{n}}\biggr| \le \frac{2}{\sqrt{n}}.$$ It is clear that the same bound holds even if $k=l$. Thus, $$\gamma_0(x) \le \frac{2}{\sqrt{n}} \ \text{ for all } x\in {\mathbb{R}}^{\mathcal{I}}.$$ Next, let $\mathcal{R}$ and $\mathcal{S}$ be as in , and take any $\alpha \in \mathcal{R}$, $\beta \in \mathcal{S}$. Then by the Cauchy-Schwarz inequality, we have $$\begin{aligned} \biggl|\sum_{(k,l)\in {\mathcal{I}}} \sum_{i,j=1}^n \alpha_{kl}\beta_{ij} {\frac{\partial a_{ij}}{\partial x_{kl}}}\biggr| &\le \frac{1}{\sqrt{n}} \sum_{(k,l)\in {\mathcal{I}}} |\alpha_{kl}(\beta_{kl}+ \beta_{lk})|\le \frac{2}{\sqrt{n}}.\end{aligned}$$ Thus, $$\gamma_1(x) \le \frac{2}{\sqrt{n}} \ \text{ for all } x\in {\mathbb{R}}^{\mathcal{I}}.$$ Now, it is clear that $\gamma_2(x) \equiv 0$ and $r(x) \le n$. Thus, if we define $\eta_0$, $\eta_1$, and $\eta_2$ as in Theorem \[matrix\], and let $\lambda(x)$ be the spectral radius of $A(x)$, then for all $x\in {\mathbb{R}}^{\mathcal{I}}$ we have $$\begin{aligned} \eta_0(x) &\le \frac{2f_1(\lambda(x))}{\sqrt{n}},\\ \eta_1(x) &\le 2f_1(\lambda(x)), \ \text{ and }\\ \eta_2(x) &\le \frac{4f_2(\lambda(x))}{n}.\end{aligned}$$ This gives $$\begin{aligned} \kappa_0 \le \frac{4({\mathbb{E}}f_1(\lambda)^4)^{1/2}}{\sqrt{n}}, \ \kappa_1 \le 2({\mathbb{E}}f_1(\lambda)^4)^{1/4}, \ \text{and} \ \kappa_2 \le \frac{4({\mathbb{E}}f_2(\lambda)^4)^{1/4}}{n}.\end{aligned}$$ Plugging these values into Theorem \[matrix\], we get the result. Gaussian matrices with correlated entries ----------------------------------------- Suppose we have a collection $X = (X_{ij})_{1\le i, j\le n}$ of jointly gaussian random variables with mean zero and $n^2 \times n^2$ covariance matrix $\Sigma$. Let $A = n^{-1/2}(X_{ij})_{1\le i,j\le n}$. Note that $A$ may be non-symmetric. Limiting behavior of the spectrum in such matrices have been recently investigated by Anderson and Zeitouni @andersonzeitouni06 under special structures on $\Sigma$. We have the following general result. \[corrwigner\] Take an entire function $f$ and define $f_1$, $f_2$ as in Theorem \[matrix\]. Let $\lambda$ denote the operator norm of $A$. Let $a = ({\mathbb{E}}f_1(\lambda)^4)^{1/4}$ and $b = ({\mathbb{E}}f_2(\lambda)^4)^{1/4}$. Suppose $W= {\operatorname{Re}}{\operatorname{Tr}}f(A)$ has finite fourth moment and let $\sigma^2 = {\mathrm{Var}}(W)$. Let $Z$ be a normal random variable with the same mean and variance as $W$. Then $$d_{TV}(W, Z) \le \frac{2\sqrt{5}\|\Sigma\|^{3/2}ab}{\sigma^2n}.$$ The computations of $\kappa_1$ and $\kappa_2$ are exactly the same as for Wigner matrices. The only difference is that we now apply the second part of Theorem \[matrix\]. Of course, the limiting behavior of $\sigma^2$ is not known, so this does not prove a central limit theorem as long as such results are not established. The term $\|\Sigma\|^{3/2}$ can often be handled by the well-known Gershgorin bound for the operator norm: $$\|\Sigma\|\le \max_{1\le i,j\le n} \sum_{k,l=1}^n |\sigma_{ij,kl}|,$$ where $\sigma_{ij,kl} = {\mathrm{Cov}}(X_{ij}, X_{kl})$. The next example gives a concrete application of the above result. Gaussian Toeplitz matrices -------------------------- Fix a number $n$ and let $X_0,\ldots,X_{n-1}$ be independent standard gaussian random variables. Let $A_n$ be the matrix $$A_n := n^{-1/2}(X_{|i-j|})_{1\le i,j\le n}.$$ This is a gaussian Toeplitz matrix, of the kind recently considered in Bryc, Dembo, and Jiang @brycdembojiang06 and also in M. Meckes @meckes06 and Bose and Sen @bosesen07. Although Toeplitz determinants have been extensively studied (see e.g. Basor @basor05 and references therein), to the best of our knowledge, there are no existing central limit theorems for general linear statistics of eigenvalues of random Toeplitz matrices. We have the following result. \[toeplitz\] Consider the gaussian Toeplitz matrices defined above. Let $p_n$ be a sequence of positive integers such that $p_n = o(\log n/\log \log n)$. Let $W_n = {\operatorname{Tr}}(A_n^{p_n})$. Then, as $n {\rightarrow}\infty$, $$\frac{W_n - {\mathbb{E}}(W_n)}{\sqrt{{\mathrm{Var}}(W_n)}} \ \text{ converges in total variation to } \ N(0,1).$$ Moreover, there exists a positive constant $C$ such that ${\mathrm{Var}}(W_n) \ge (C/p_n)^{p_n}n$ for all $n$. The central limit theorem also holds for $W_n = {\operatorname{Tr}}f(A_n)$, when $f$ is a fixed nonzero polynomial with nonnegative coefficients. In that case, ${\mathrm{Var}}(W_n)\ge Cn$ for some positive constant $C$ depending on $f$. <span>*Remarks.*</span> (i) Note that the theorem is only for <span>*gaussian*</span> Toeplitz matrices. In fact, considering the function $f(x)=x$, we see that a CLT need not always hold for linear statistics of non-gaussian Toeplitz matrices. \(ii) This is an example of a matrix ensemble where nothing is known about the limiting formula for ${\mathrm{Var}}(W_n)$. Theorem \[matrix\] enables us to prove the CLT even without knowing the limit of ${\mathrm{Var}}(W_n)$. As before, this is possible because we can easily get lower bounds on ${\mathrm{Var}}(W_n)$. In the notation of the previous subsection, $$\sigma_{ij,kl} = \begin{cases} 1 &\text{ if } |i-j|=|k-l|,\\ 0 &\text{ otherwise.} \end{cases}$$ Thus, $$\|\Sigma\|\le \max_{i,j} \sum_{k,l} |\sigma_{ij,kl}| \le 2n.$$ Let $\lambda_n$ denote the spectral norm of $A_n$. Using Proposition \[corrwigner\] and the above bound on $\|\Sigma\|$, we have $$\label{toepbd} d_{TV}(W_n,Z_n) \le \frac{Cp_n^2 ({\mathbb{E}}\lambda_n^{4p_n})^{1/2}\sqrt{n}}{{\mathrm{Var}}(W_n)},$$ where $Z_n$ is a gaussian random variable with the same mean and variance as $W_n$ and $C$ is a universal constant. In the rest of the argument we will write $p$ instead of $p_n$ to ease notation. First, note that $$W_n = {\operatorname{Tr}}(A_n^p) = n^{-p/2}\sum_{1\le i_1,\ldots,i_p\le n}X_{|i_1-i_2|}X_{|i_2-i_3|}\cdots X_{|i_p-i_1|}.$$ As in the proof of Theorem \[wignerthm\], it is easy to verify that all terms in the above sum are positively correlated with each other, and hence, for any partition $\mathcal{D}$ of the set $\{1,\ldots,n\}^p$ into disjoint subcollections, $$\label{varbdd} {\mathrm{Var}}(W_n) \ge n^{-p}\sum_{D\in \mathcal{D}} {\mathrm{Var}}\biggl(\sum_{(i_1,\ldots,i_p)\in D}X_{|i_1-i_2|}X_{|i_2-i_3|}\cdots X_{|i_p-i_1|}\biggr).$$ For any collection of distinct positive integers $1\le a_1,\ldots,a_{p-1}\le \lceil n/3p\rceil $, let $D_{a_1,\ldots,a_{p-1}}$ be the set of all $1\le i_1,\ldots,i_p\le n$ such that $i_{k+1}- i_k = a_k$ for $k=1,\ldots,p-1$ and $1\le i_1\le \lceil n/3 \rceil $. Clearly, $|D_{a_1,\ldots, a_{p-1}}| = \lceil n/3\rceil$. Again, since the $a_i$'s are distinct, $$\begin{aligned} &{\mathrm{Var}}\biggl(\sum_{(i_1,\ldots,i_p)\in D_{a_1,\ldots,a_{p-1}}}X_{|i_1-i_2|}X_{|i_2-i_3|}\cdots X_{|i_p-i_1|}\biggr) \\ &= |D_{a_1,\ldots,a_{p-1}}|^2 {\mathrm{Var}}(X_{a_1}\cdots X_{a_{p-1}} X_{a_1+\cdots+a_{p-1}}) = |D_{a_1,\ldots,a_{p-1}}|^2 \ge \frac{n^2}{9}.\end{aligned}$$ Next, note that the number of ways to choose $a_1,\ldots, a_{p-1}$ satisfying the restrictions is $$\lceil n/3p\rceil (\lceil n/3p \rceil - 1)\cdots (\lceil n/3p\rceil - p +2 ).$$ Since we can assume, without loss of generality, that $n\ge 4 p^2$, the above quantity can be easily seen to be lower bounded by $(n/12p)^{p-1}$. Finally, noting that if $(a_1,\ldots,a_{p-1})\ne (a_1',\ldots,a_{p-1}')$, then $D_{a_1,\ldots,a_{p-1}}$ and $D_{a_1',\ldots,a_{p-1}'}$ are disjoint, and applying , we get $$\label{toepvarbd} {\mathrm{Var}}(W_n) \ge n^{-p} \frac{n^{p-1}}{(12p)^{p-1}} \frac{n^2}{9} \ge \frac{C^pn}{p^p},$$ where $C$ is a positive universal constant. Next, let $\lambda_n$ denote the spectral norm of $A_n$. By Theorem 1 of M. Meckes @meckes06, we know that ${\mathbb{E}}(\lambda_n) \le C\sqrt{\log n}$. Now, it is easy to verify that the map $(X_0,\ldots,X_{n-1})\mapsto \lambda_n$ has Lipschitz constant bounded irrespective of $n$. By standard gaussian concentration results (e.g. Ledoux @ledoux01, Sections 5.1-5.2), it follows that for any $k$, $${\mathbb{E}}|\lambda_n - {\mathbb{E}}(\lambda_n)|^k \le C^{k/2} k^{k/2},$$ where, again, $C$ is a universal constant. Combining with result for ${\mathbb{E}}(\lambda_n)$, it follows that for any $n$ and $k$, $${\mathbb{E}}(\lambda_n^k) \le (C k\log n)^{k/2}.$$ Thus, the term $p^2 ({\mathbb{E}}\lambda_n^{4p})^{1/2}$ in is bounded by $p^2 (Cp\log n)^p$. Therefore, from and , it follows that $$d_{TV}(W_n, Z_n) \le \frac{C^p p^{2p+2} (\log n)^p}{\sqrt{n}},$$ where $C$ is a universal constant. Clearly, if $p = o(\log n/\log \log n)$, this goes to zero. This completes the proof for $W_n = {\operatorname{Tr}}(A_n^{p_n})$. When $W_n = {\operatorname{Tr}}f (A_n)$, where $f$ is a fixed polynomial with nonnegative coefficients, the proof goes through exactly as above. If $f(x) = c_0 + \cdots + c_k x^k$, the nonnegativity of the coefficients ensures that ${\mathrm{Var}}(W_n)\ge c_k^2{\mathrm{Var}}({\operatorname{Tr}}A_n^k)$, and we can re-use the bounds computed before to show that ${\mathrm{Var}}(W_n) \ge C(f)n$. The rest is similar. Wishart matrices ---------------- Let $n\le N$ be two positive integers, and let $X = (X_{ij})_{1\le i\le n, 1\le j\le N}$ be a collection of independent random variables in ${\mathcal{L}}(c_1,c_2)$ for some finite $c_1,c_2$. Let $$A = N^{-1} X X^t.$$ In statistical parlance, the matrix $A$ is called the <span>*Wishart matrix*</span> or <span>*sample covariance matrix*</span> corresponding to the <span>*data matrix*</span> $X$. Just as in the Wigner case, linear statistics of eigenvalues of Wishart matrices also satisfy unnormalized central limit theorems under certain conditions. This was proved for polynomial $f$ by Jonsson @jonsson82, and for a much larger class of functions in Bai and Silverstein @baisilverstein04. A different proof was recently given by Anderson and Zeitouni @andersonzeitouni06a. We have the following error bound. \[covprop\] Let $\lambda$ be the largest eigenvalue of $A$. Take any entire function $f$ and define $f_1$, $f_2$ as in Theorem \[matrix\]. Let $a = ({\mathbb{E}}(f_1(\lambda)^4\lambda^2))^{1/4}$ and $b = ({\mathbb{E}}(f_1(\lambda) + 2n^{-1/2}f_2(\lambda)\lambda)^4)^{1/4}$. Suppose $W= {\operatorname{Re}}{\operatorname{Tr}}f(A)$ has finite fourth moment and let $\sigma^2 = {\mathrm{Var}}(W)$. Let $Z$ be a normal random variable with the same mean and variance as $W$. Then $$d_{TV}(W, Z) \le \frac{8\sqrt{5}}{\sigma^2}\biggl(\frac{c_1 c_2 a^2\sqrt{n}}{N} + \frac{c_1^3 ab n}{N^{3/2}}\biggr).$$ If we now change the setup and assume that the entries of $X$ are jointly gaussian with mean $0$ and $nN \times nN$ covariance matrix $\Sigma$, keeping all other notation the same, then the corresponding bound is $$d_{TV}(W, Z) \le \frac{8\sqrt{5}\|\Sigma\|^{3/2} ab n}{\sigma^2N^{3/2}}.$$ <span>*Remarks.*</span> (i) As in the Wigner case, it is well known that under mild conditions, $\lambda = O(1)$ as $n, N {\rightarrow}\infty$ with $n/N{\rightarrow}c\in [0,1)$. We refer to Section 2.2.2 in the survey article @bai99 for details. It follows that $a$ and $b$ are $O(1)$. (ii) It is shown in @baisilverstein04 that in the case of independent entries, if $n/N {\rightarrow}c\in (0,1)$, then $\sigma^2$ converges to a finite positive constant under fairly general conditions (an explicit formula for the limit is also available). Therefore under such conditions, the first bound above is of order $1/\sqrt{N}$. \(iii) We should remark that the spectrum of $XX^t$ is often studied by studying the block matrix $$\biggl( \begin{array}{cc} 0 & X\\ X^t & 0 \end{array} \biggr),$$ because $$\biggl( \begin{array}{cc} 0 & X\\ X^t & 0 \end{array} \biggr)^2 = \biggl( \begin{array}{cc} XX^t & 0\\ 0 & X^tX \end{array} \biggr).$$ Thus, in principle, we can derive Proposition \[covprop\] using the information contained in Lemma \[wigner\]. However, for expository purposes, we prefer carry out the explicit computations necessary for applying Theorem \[matrix\] without resorting to the above trick. The computations will also be helpful in dealing with the double Wishart case in the next subsection. \[Proof of Proposition \[covprop\]\] First, let us define the indexing set $${\mathcal{I}}= \{(p,q): p=1,\ldots,n, q =1,\ldots, N\}.$$ From now on, we simply write $pq$ instead of $(p,q)$. Let $x = (x_{pq})_{pq\in {\mathcal{I}}}$ be a typical element of ${\mathbb{R}}^{\mathcal{I}}$. In the following, the collection $x$ is used as a matrix, and it seems that the only way to avoid confusion is to write $X$ instead of $x$, so we do that. Generally, there is no harm in confusing this $X$ with the collection of random variables defined at the onset. Let $\gamma_0$, $\gamma_1$, and $\gamma_2$ be defined as in . For each $m$ and $i$, let $e_{mi}$ be the $i^{\mathrm{th}}$ coordinate vector in ${\mathbb{R}}^m$, i.e. the vector whose $i^{\mathrm{th}}$ component is $1$ and the rest are zero. Then $${\frac{\partial A}{\partial x_{pq}}} = N^{-1}( e_{np}e_{Nq}^t X^t + X e_{Nq}e_{np}^t),$$ and $$\label{der2} \begin{split} {\frac{\partial^2 A}{\partial x_{pq} \partial x_{rs}}} &= N^{-1}(e_{np}e_{Nq}^t e_{Ns}e_{nr}^t + e_{nr} e_{Ns}^t e_{Nq} e_{np}^t)\\ &= \begin{cases} N^{-1}(e_{np}e_{nr}^t + e_{nr} e_{np}^t) &\text{ if } q=s,\\ 0 &\text{ otherwise.} \end{cases} \end{split}$$ Now take any $n\times n$ matrix $B$ with $\|B\| = 1$. Then for any $p,q$, $$\begin{aligned} \biggl|{\operatorname{Tr}}\biggl(B{\frac{\partial A}{\partial x_{pq}}}\biggr)\biggr| &= N^{-1} |{\operatorname{Tr}}(B e_{np}e_{Nq}^t X^t + B Xe_{Nq} e_{np}^t)|\\ &= N^{-1}| e_{Nq}^t X^tBe_{np} + e_{np}^t BX e_{Nq}| \\ &\le 2N^{-1}\|B\|\|X\| = 2\sqrt{\frac{\lambda}{N}}.\end{aligned}$$ This shows that $$\gamma_0 \le 2\sqrt{\frac{\lambda}{N}}.$$ Next, let $\alpha = (\alpha_{pq})_{1\le p\le n, 1\le q\le N}$, $\alpha' = (\alpha_{pq})_{1\le p\le n, 1\le q\le N}$, and $\beta = (\beta_{ij})_{1\le i, j\le n}$ be arbitrary matrices of complex numbers such that $\|\alpha\|_{HS} = \|\alpha'\|_{HS} = \|\beta\|_{HS} = 1$. Then $$\begin{aligned} &\biggl|\sum_{p=1}^n \sum_{q=1}^N \sum_{i,j=1}^n \alpha_{pq}\beta_{ij} {\frac{\partial a_{ij}}{\partial x_{pq}}}\biggr|\\ &= N^{-1}\biggl|\sum_{p=1}^n \sum_{q=1}^N \sum_{i,j=1}^n \alpha_{pq}\beta_{ij} e_{ni}^t(e_{np}e_{Nq}^t X^t + X e_{Nq} e_{np}^t)e_{nj}\biggr|\\ &= N^{-1}\biggl|\sum_{p=1}^n \sum_{q=1}^N \sum_{j=1}^n\alpha_{pq}\beta_{pj}x_{jq} + \sum_{p=1}^n \sum_{q=1}^N \sum_{i=1}^n\alpha_{pq}\beta_{ip}x_{iq}\biggr|\\ &= N^{-1}\bigl|{\operatorname{Tr}}(\alpha X^t \beta^t) + {\operatorname{Tr}}(\alpha X^t \beta)\bigr|.\end{aligned}$$ By Lemma \[trivial\], we have $$\begin{aligned} |{\operatorname{Tr}}(\alpha X^t \beta^t)+{\operatorname{Tr}}(\alpha X^t \beta)| &\le 2\|\alpha\|_{HS}\|X\| \|\beta\|_{HS} = 2\sqrt{N\lambda}.\end{aligned}$$ Thus, $$\gamma_1 \le 2\sqrt{\frac{\lambda}{N}}.$$ Again, by the formula for second derivatives of $A$, $$\begin{aligned} &\biggl|\sum_{p,r=1}^n\sum_{q,s=1}^N \sum_{i,j=1}^n \alpha_{pq}\alpha_{rs}'\beta_{ij}{\frac{\partial^2 a_{ij}}{\partial x_{pq} \partial x_{rs}}}\biggr| \\ &= N^{-1}\biggl|\sum_{p,r=1}^n\sum_{q=1}^N \sum_{i,j=1}^n \alpha_{pq}\alpha_{rq}'\beta_{ij}e_{ni}^t(e_{np}e_{nr}^t + e_{nr}e_{np}^t)e_{nj}\biggr|\\ &= N^{-1}\biggl|\sum_{p,r=1}^n\sum_{q=1}^N \alpha_{pq}\alpha_{rq}'(\beta_{pr}+ \beta_{rp}) \biggr|\\ &= N^{-1}\bigl|{\operatorname{Tr}}(\alpha{\alpha'}^t \beta^t) + {\operatorname{Tr}}(\alpha{\alpha'}^t \beta)\bigr| \le 2N^{-1}\|\alpha\|_{HS}\|\alpha'\|_{HS} \|\beta\|_{HS}.\end{aligned}$$ This shows that $$\gamma_2\le \frac{2}{N}.$$ Finally, note that $\mathrm{rank}(A) \le n$. Combining the bounds we get $$\begin{aligned} \eta_0 \le 2f_1(\lambda)\sqrt{\frac{\lambda}{N}}, \ \ \eta_1 \le 2f_1(\lambda)\sqrt{\frac{\lambda n}{N}}, \ \text{ and } \ \eta_2 \le \frac{2f_1(\lambda)\sqrt{n}}{N} + \frac{4f_2(\lambda)\lambda}{N}.\end{aligned}$$ From this, we get $$\begin{aligned} \kappa_0 &\le \frac{4\sqrt{n}}{N}({\mathbb{E}}(f_1(\lambda)^4\lambda^2))^{1/2},\\ \kappa_1 &\le \frac{2\sqrt{n}}{\sqrt{N}}({\mathbb{E}}(f_1(\lambda)^4 \lambda^2))^{1/4},\ \ \text{and}\\ \kappa_2 &\le \frac{2\sqrt{n}}{N}({\mathbb{E}}(f_1(\lambda) + 2n^{-1/2}f_2(\lambda) \lambda)^4)^{1/4}.\end{aligned}$$ With the aid of Theorem \[matrix\], this completes the proof. Double Wishart matrices ----------------------- Let $n\le N\le M$ be three positive integers, and let $X = (X_{ij})_{1\le i\le n, 1\le j\le N}$ be and $Y = (Y_{ij})_{1\le i\le n, 1\le j\le M}$ be two collections of independent random variables in ${\mathcal{L}}(c_1,c_2)$ for some finite $c_1,c_2$. Let $$A = X X^t (YY^t)^{-1}.$$ A matrix like $A$ is called a <span>*double Wishart matrix*</span>. Double Wishart matrices are very important in statistical theory of canonical correlations (see the discussion in Section 2.2 of @johnstone06). If the matrices $X$ and $Y$ had independent standard gaussian entries, the matrix $XX^t(XX^t + YY^t)^{-1}$ would be known as a <span>*Jacobi*</span> matrix. In a recent preprint, Jiang @jiang06 proves the CLT for the Jacobi ensemble. We have the following result. \[double\] Let $\lambda_x$ and $\lambda_y$ be the largest eigenvalues of $N^{-1}XX^t$ and $M^{-1}YY^t$, and let $\delta_y$ be the smallest eigenvalue of $M^{-1}YY^t$. Let $\lambda = \max\{1,\lambda_x,\lambda_y, \delta_y^{-1}\}$. Take any entire function $f$ and define $f_1$, $f_2$ as in Theorem \[matrix\]. Let $a = ({\mathbb{E}}(f_1(\lambda)^4 \lambda^{14}))^{1/4}$ and $$b = ({\mathbb{E}}(4f_1(\lambda)\lambda^5 + 2n^{-1/2}f_2(\lambda) \lambda^7)^4)^{1/4}.$$ Suppose $W= {\operatorname{Re}}{\operatorname{Tr}}f(A)$ has finite fourth moment and let $\sigma^2 = {\mathrm{Var}}(W)$. Let $Z$ be a normal random variable with the same mean and variance as $W$. Then $$d_{TV}(W, Z) \le \frac{4\sqrt{10}}{\sigma^2}\biggl(\frac{c_1 c_2 a^2N\sqrt{n}}{M^2} + \frac{2c_1^3 ab \sqrt{N}n}{M^2}\biggr).$$ <span>*Remarks.*</span> (i) Assume that $n$, $N$, and $M$ grow to infinity at the same rate (we refer to this as the 'large dimensional limit'). From the results about the extreme eigenvalues of Wishart matrices (@bai99, Section 2.2.2), it is clear that $\lambda = O(1)$, and hence $a$, $b$ are stochastically bounded. (ii) There are no rigorous results about the behavior of $\sigma^2$ in the large dimensional limit, other than in the gaussian case, which has been settled in @jiang06, where it is shown that $\sigma^2$ converges to a finite limit. (iii) When the entries of $X$ and $Y$ are jointly gaussian and some conditions on the dimensions are satisfied, the exact joint distribution of the eigenvalues of $A$ is known (see @johnstone06, Section 2.2 for references and an interesting story). While it may be possible to derive a CLT for the gaussian case using the explicit form of this density, it is hard to see how the non-gaussian case can be handled by either the method of moments or Stieltjes transforms. \(iv) In principle, it seems something could be said using the second order freeness results of Mingo and Speicher @mingospeicher06. However, to the best of our knowledge, an explicit CLT for double Wishart matrices has not been worked out using second order freeness. \[Proof of Proposition \[double\]\] For convenience,
{'source': 'arXiv_out/0705'}