 the unit Euclidean norm eigenvector associated with $\lambda_{n,j}$. Then the empirical probability transition matrix $P_n$ has the decomposition $$\begin{aligned}
P_{n}^t = \sum_{j=0}^{n-1} \lambda_{n,j}^t\, \psi_{n,j}\,\varphi_{n,j}^T,\end{aligned}$$ where $\psi_{n,j} = D_n^{-1/2}\,\phi_{n,j}\in{\mathbb{R}}^n$ and $\varphi_{n,j} = D_n^{1/2}\phi_{n,j}\in{\mathbb{R}}^n$, so that $\psi_{n,j}=D_n^{-1} \varphi_{n,j}$ for each $j\in\{0,1,\dots,n-1\}$. In particular, $\psi_{n,j}$ has unit $L^2(\mbox{diag}(D_n))$ norm, and $\varphi_{n,j}$ has unit $L^2(\mbox{diag}(D_n^{-1}))$ norm, for each $j\in\{0,1,\dots,n-1\}$.

In addition, we have the following relation between the diffusion affinity and $P_n^{2t}$, $$\begin{aligned}
\langle X_i,\, X_j\rangle_{D_{n,t}} = \sum_{l=0}^{n-1} \lambda_{n,l}^{2t} \,[\psi_{n,l}]_i \, [\psi_{n,l}]_j =\sum_{l=0}^{n-1} \lambda_{n,l}^{2t} \, [\psi_{n,l}]_i \, [\varphi_{n,l}]_j d_n^{-1}(X_j)
=[P_n^{2t}D_n^{-1}]_{ij}.\end{aligned}$$

Technical proofs
================

In this appendix, we collect some technical lemmas used in the proofs of our main results.

\[lem:some\_ineq\_feasible\_set\] Let $Z^{*}$ be defined in (\[eqn:Kmeans\_true\_membership\_matrix\]). Then for any $Z \in {\mathscr{C}}$ defined in, we have $$\begin{aligned}
\label{eqn:ineq_1_
the unit Euclidean norm eigenvector associated with $ \lambda_{n, j}$. Then the empirical probability transition matrix $ P_n$ take the decay $ $ \begin{aligned } 
 P_{n}^t = \sum_{j=0}^{n-1 } \lambda_{n, j}^t\, \psi_{n, j}\,\varphi_{n, j}^T,\end{aligned}$$ where $ \psi_{n, j } = D_n^{-1/2}\,\phi_{n, j}\in{\mathbb{R}}^n$ and $ \varphi_{n, j } = D_n^{1/2}\phi_{n, j}\in{\mathbb{R}}^n$, so that $ \psi_{n, j}=D_n^{-1 } \varphi_{n, j}$ for each $ j\in\{0,1,\dots, n-1\}$. In especial, $ \psi_{n, j}$ have unit $ L^2(\mbox{diag}(D_n))$ norm, and $ \varphi_{n, j}$ have unit $ L^2(\mbox{diag}(D_n^{-1}))$ norm, for each $ j\in\{0,1,\dots, n-1\}$. 

 In addition, we have the following relation back between the diffusion affinity and $ P_n^{2t}$, $ $ \begin{aligned } 
 \langle X_i,\, X_j\rangle_{D_{n, t } } = \sum_{l=0}^{n-1 } \lambda_{n, l}^{2 t } \,[\psi_{n, l}]_i \, [ \psi_{n, l}]_j = \sum_{l=0}^{n-1 } \lambda_{n, l}^{2 t } \, [ \psi_{n, l}]_i \, [ \varphi_{n, l}]_j d_n^{-1}(X_j) 
 =[ P_n^{2t}D_n^{-1}]_{ij}.\end{aligned}$$ 

 Technical proofs 
 = = = = = = = = = = = = = = = = 

 In this appendix, we roll up some technical lemmas used in the proofs of our main results. 

 \[lem: some\_ineq\_feasible\_set\ ] permit $ Z^{*}$ be defined in (\[eqn: Kmeans\_true\_membership\_matrix\ ]). Then for any $ Z \in { \mathscr{C}}$ defined in, we consume $ $ \begin{aligned } 
 \label{eqn: ineq_1 _
 thf unit Euclidean norm einenvector associcred wivh $\lambsa_{n,j}$. Thev the empirical probability vranwitiob matrix $P_n$ has the dezompositiln $$\begin{qligied}
P_{n}^t = \sum_{j=0}^{n-1} \lambda_{n,j}^t\, \ifi_{n,j}\,\bwrphn_{n,o}^T,\end{aligned}$$ whgre $\psi_{n,j} = D_t^{-1/2}\,\phi_{n,j}\in{\mathbb{S}}^n$ aud $\varphi_{n,j} = D_n^{1/2}\phi_{n,j}\in{\mathbb{R}}^n$, so thwt $\psi_{n,k}=D_j^{-1} \varphi_{n,j}$ for eacn $j\in\{0,1,\sots,n-1\}$. In particular, $\psi_{n,j}$ has unit $L^2(\mbox{dpag}(D_n))$ norm, and $\vatphi_{n,j}$ has unit $L^2(\mbox{diag}(D_j^{-1}))$ nogm, for each $j\in\{0,1,\dotd,n-1\}$.

In additiin, wq have the foulowing relation betwegn the diffusion affinity and $P_n^{2g}$, $$\begnn{aligned}
\labgoe D_h,\, X_j\rangle_{D_{i,t}} = \sui_{l=0}^{n-1} \lambda_{n,l}^{2b} \,[\psi_{n,l}]_h \, [\psi_{n,k}]_j =\sum_{l=0}^{n-1} \lambds_{n,l}^{2v} \, [\pwi_{n,l}]_i \, [\varphi_{n,l}]_j d_n^{-1}(X_j)
=['_n^{2t}D_n^{-1}]_{ij}.\end{aligned}$$

Tecrnical prmoys
================

In this appendix, we cillecj soma tezynizal lxmmzs usef ii the proofa of our maun results.

\[lem:some\_intq\_fqqsible\_set\] Let $Z^{*}$ be qesined in (\[eqn:Kmeans\_true\_membership\_matrix\]). Uhen ror any $Z \in {\mathscr{C}}$ dwfined in, we have $$\begln{aligned}
\jabel{eqn:ineq_1_
the unit Euclidean norm eigenvector associated with the probability transition $P_n$ has the \lambda_{n,j}^t\, where $\psi_{n,j} = and $\varphi_{n,j} = so that $\psi_{n,j}=D_n^{-1} \varphi_{n,j}$ for each In particular, $\psi_{n,j}$ has unit $L^2(\mbox{diag}(D_n))$ norm, and $\varphi_{n,j}$ has unit $L^2(\mbox{diag}(D_n^{-1}))$ norm, each $j\in\{0,1,\dots,n-1\}$. In addition, we have the following relation between the diffusion affinity $P_n^{2t}$, \langle X_j\rangle_{D_{n,t}} \sum_{l=0}^{n-1} \lambda_{n,l}^{2t} \,[\psi_{n,l}]_i \, [\psi_{n,l}]_j =\sum_{l=0}^{n-1} \lambda_{n,l}^{2t} \, [\psi_{n,l}]_i \, [\varphi_{n,l}]_j d_n^{-1}(X_j) =[P_n^{2t}D_n^{-1}]_{ij}.\end{aligned}$$ Technical proofs ================ this appendix, we collect some technical lemmas used the proofs of our results. \[lem:some\_ineq\_feasible\_set\] Let $Z^{*}$ be in Then for $Z {\mathscr{C}}$ in, we have \label{eqn:ineq_1_
 the unit Euclidean norm eigenVector assoCiateD wiTh $\lAmBda_{n,J}$. TheN the empirical pRObabIlity transition matrix $P_N$ has tHe DEcomPOsItion $$\Begin{alIGnED}
p_{n}^t = \SuM_{j=0}^{N-1} \laMbDA_{n,J}^t\, \psi_{N,j}\,\vArphi_{n,j}^t,\end{aligneD}$$ whErE $\psi_{n,j} = D_n^{-1/2}\,\phi_{n,J}\In{\Mathbb{R}}^n$ anD $\vaRphi_{n,j} = D_n^{1/2}\phi_{n,J}\in{\Mathbb{r}}^n$, So tHAt $\psi_{N,j}=D_N^{-1} \varpHi_{n,j}$ foR Each $j\iN\{0,1,\dots,n-1\}$. In pArTIcular, $\PSi_{n,j}$ has UNIt $l^2(\mboX{diag}(D_n))$ norm, and $\varPHi_{N,J}$ has unit $L^2(\mbox{dIag}(D_n^{-1}))$ nOrM, FoR EAch $J\in\{0,1,\Dots,n-1\}$.

In addItIon, we HAve the fOLlOWINg rELation between The diffusioN AffInity aNd $p_n^{2t}$, $$\BEgin{alIgned}
\LaNGle x_i,\, X_j\rangle_{D_{N,t}} = \suM_{l=0}^{n-1} \lambda_{N,l}^{2t} \,[\psi_{N,L}]_i \, [\psi_{n,l}]_J =\Sum_{l=0}^{n-1} \laMbda_{n,l}^{2T} \, [\psI_{n,l}]_I \, [\varPHi_{N,l}]_J d_n^{-1}(x_j)
=[p_N^{2t}D_N^{-1}]_{Ij}.\End{ALigNed}$$

TechnIcAl ProofS
================

In tHIS APpenDix, We coLlect Some technical LemMas uSEd iN the pRoofs Of ouR mAin reSults.

\[lEm:somE\_iNeq\_feasible\_set\] LEt $Z^{*}$ bE defined iN (\[eqN:KMeaNs\_True\_mEMbershIp\_mAtrIx\]). Then fOr any $Z \iN {\MatHsCR{c}}$ DeFined in, we have $$\begin{AlIGNeD}
\label{eqN:ineq_1_
 the unit Euclidean norm e igenvector  asso cia ted  w ith$\la mbda_{n,j}$. T h en t he empirical probabili ty tr an s itio n  m atrix  $P_n$h as t hede co mpo si t io n $$\ beg in{alig ned}
P_{n} ^t=\sum_{j=0}^{ n -1 } \lambda_ {n, j}^t\, \psi_ {n, j}\,\v ar phi _ {n,j} ^T, \end{ aligne d }$$ wh ere $\psi _{ n ,j} =D _n^{-1/ 2 } \, \phi _{n,j}\in{\mathbb { R} } ^n$ and $\varp hi_{n, j} =D _ n^{ 1/2 }\phi_{n,j }\ in{\m a thbb{R} } ^n $ , sot hat $\psi_{n, j}=D_n^{-1} \va rphi_{ n, j}$ for ea ch $j \i n \{0 ,1,\dots,n- 1\}$ . In part icular ,  $\psi_ { n,j}$ h as uni t $ L^2 (\mb o x{ di ag} (D _ n)) $  n orm ,  an d $\varp hi _{ n,j}$  has u n i t $L ^2( \mbo x{dia g}(D_n^{-1})) $ n orm, for  each  $j\i n\{0 ,1 ,\dot s,n-1\ }$.
In  addition, we h avethe follo win grel at ion b e tweenthe  di ffusion  affini t y a nd $ P _n ^{2t}$, $$\begin{a li g n ed }
\langl e X_i, \ ,X_ j \rangle_ {D _{n ,t}} =  \sum _{l= 0 }^ {n-1} \l ambda_ { n, l} ^{2t} \ ,[ \psi_{ n, l}] _i\, [\ p si_{ n,l}]_ j =\sum_ {l=0} ^ {n-1} \lambda_ { n,l}^{2t} \,[ \p s i _{ n ,l}] _i\, [\varphi _{n, l }]_j  d_n ^ {- 1}( X _j)
= [P_n^ {2 t }D _ n^{-1}]_{ij}.\end{a li gned}$ $

Te chnical proof s
======== = = = =====

I n th i sa ppendix, we co llect  some tech n ical lem mas u sed in t he proofs o f our ma inres ult s.\ [l em:some\_ineq \ _ feas ib le\_set \]Let $Z^ {*} $ b e d efi ne d in (\[e qn:Kmean s\ _t ru e\ _me mbers h ip\_matr ix \]) .The n for any $Z  \in{\ma th sc r {C} }$ defi n ed i n, w eha ve $ $\b eg in{al igne d }
\ label{e qn:ineq_1 _
 the_unit Euclidean_norm eigenvector associated with_$\lambda_{n,j}$. Then_the_empirical probability_transition_matrix $P_n$ has_the decomposition $$\begin{aligned}
P_{n}^t_= \sum_{j=0}^{n-1} \lambda_{n,j}^t\, \psi_{n,j}\,\varphi_{n,j}^T,\end{aligned}$$_where $\psi_{n,j} =_D_n^{-1/2}\,\phi_{n,j}\in{\mathbb{R}}^n$_and $\varphi_{n,j} = D_n^{1/2}\phi_{n,j}\in{\mathbb{R}}^n$, so that $\psi_{n,j}=D_n^{-1} \varphi_{n,j}$ for each $j\in\{0,1,\dots,n-1\}$. In particular, $\psi_{n,j}$_has_unit $L^2(\mbox{diag}(D_n))$_norm,_and_$\varphi_{n,j}$ has unit $L^2(\mbox{diag}(D_n^{-1}))$ norm,_for each $j\in\{0,1,\dots,n-1\}$.

In addition, we_have the_following relation between the diffusion affinity and $P_n^{2t}$,_$$\begin{aligned}
\langle_X_i,\, X_j\rangle_{D_{n,t}} =_\sum_{l=0}^{n-1} \lambda_{n,l}^{2t} \,[\psi_{n,l}]_i \, [\psi_{n,l}]_j =\sum_{l=0}^{n-1} \lambda_{n,l}^{2t} \, [\psi_{n,l}]_i_\, [\varphi_{n,l}]_j d_n^{-1}(X_j)
=[P_n^{2t}D_n^{-1}]_{ij}.\end{aligned}$$

Technical proofs
================

In this appendix,_we collect some_technical_lemmas_used in the proofs_of our main results.

\[lem:some\_ineq\_feasible\_set\] Let $Z^{*}$_be defined in (\[eqn:Kmeans\_true\_membership\_matrix\]). Then for_any $Z \in {\mathscr{C}}$ defined in, we_have $$\begin{aligned}
\label{eqn:ineq_1_