{\sigma}_i^2))$

In this case, $\boldsymbol{\mu}$ = $GCN_{\mu}$(**X**, **A**) is the matrix of mean vectors $\boldsymbol{\mu}_i$; whereas $log(\boldsymbol{\sigma})$ = $GCN_{\sigma}$(**X**, **A**). We define the two-layer GCN as GCN(**X**, **A**) = $\widetilde{\textbf{A}}\text{ReLU}(\widetilde{\textbf{A}}\textbf{X}\textbf{W}_0)\textbf{W}_1$, with weight matrices $\textbf{W}_i$.

$GCN_{\mu}$(**X** **A**) and $GCN_{\sigma}$(**X** **A**) share the parameters in the first layer defined by $\textbf{W}_0$. ReLU(n) = max(0,n) and $\widetilde{\textbf{A}}= \textbf{D}^{-\frac{1}{2}}\textbf{A}\textbf{D}^{-\frac{1}{2}}$ is the symmetrically normalized adjacency matrix.

**Generative Model**: We view the generative model as the reconstruction of the adjacency matrix from the latent variables obtained in the inference model outlined above. We use the inner product between the latent variable representations for two nodes to predict the presence of an association

$$p(\textbf{A} \mid \textbf{Z}) = \prod_{i=1}^N \prod_{j=1}^N  p(A_{ij} \mid \textbf{z}_i \text{, }\textbf{z}_j )$$

$p(A_{ij} =1 \mid \textbf{z}_i \text{, }\textbf{z}_j)$ = $\sigma(\textbf{z}_i^\top\textbf{z}_j)$

We define $A_{ij}$ to be the elements of **A** and $\sigma$ to be the sigmoid function.

**Learning**: We optimize the variational lower bound $\mathcal{L}$ w.r.t. to the parameters $\textbf{W}_i$

$$\mathcal{L} = \mathbb{E}_{q(\textbf{Z} \mid \textbf{X}, \textbf{A})} [\text{log} p(\textbf{A} \mid \textbf{Z})] - \text{KL}[q(\textbf{Z} \
{ \sigma}_i^2))$ 

 In this case, $ \boldsymbol{\mu}$ = $ GCN_{\mu}$(**X * *, * * A * *) is the matrix of mean vectors $ \boldsymbol{\mu}_i$; whereas $ log(\boldsymbol{\sigma})$ = $ GCN_{\sigma}$(**X * *, * * deoxyadenosine monophosphate * *). We specify the two - layer GCN as GCN(**X * *, * * A * *) = $ \widetilde{\textbf{A}}\text{ReLU}(\widetilde{\textbf{A}}\textbf{X}\textbf{W}_0)\textbf{W}_1 $, with weight matrix $ \textbf{W}_i$. 

 $ GCN_{\mu}$(**X * * * * A * *) and $ GCN_{\sigma}$(**X * * * * A * *) partake the parameters in the first layer specify by $ \textbf{W}_0$. ReLU(n) = max(0,n) and $ \widetilde{\textbf{A}}= \textbf{D}^{-\frac{1}{2}}\textbf{A}\textbf{D}^{-\frac{1}{2}}$ is the symmetrically normalized adjacency matrix. 

 * * Generative Model * *: We view the generative mannequin as the reconstruction of the adjacency matrix from the latent variables obtained in the inference mannequin delineate above. We use the inner product between the latent variable representations for two node to predict the presence of an association 

 $ $ p(\textbf{A } \mid \textbf{Z }) = \prod_{i=1}^N \prod_{j=1}^N   p(A_{ij } \mid \textbf{z}_i \text {, } \textbf{z}_j) $ $ 

 $ p(A_{ij } = 1 \mid \textbf{z}_i \text {, } \textbf{z}_j)$ = $ \sigma(\textbf{z}_i^\top\textbf{z}_j)$ 

 We specify $ A_{ij}$ to be the elements of * * A * * and $ \sigma$ to be the sigmoid function. 

 * * Learning * *: We optimize the variational lower bound $ \mathcal{L}$ w.r.t. to the parameter $ \textbf{W}_i$ 

 $ $ \mathcal{L } = \mathbb{E}_{q(\textbf{Z } \mid \textbf{X }, \textbf{A }) } [ \text{log } p(\textbf{A } \mid \textbf{Z }) ] - \text{KL}[q(\textbf{Z } \
{\sigla}_i^2))$

In this case, $\boldsymbul{\mu}$ = $GCN_{\mu}$(**X**, **A**) nw the katrix of mean vectors $\boldsymbol{\mu}_i$; wherees $lig(\bolesymbol{\sigma})$ = $GCN_{\sigma}$(**B**, **A**). We devine the two-oqyer GCN as GCN(**X**, **A**) = $\widefllde{\tzxvbf{A}}\text{ReLU}(\widgtilde{\textbf{D}}\textbf{X}\textbf{F}_0)\tdxcbf{W}_1$, with weight matrices $\textbf{W}_i$.

$GCG_{\mu}$(**X** **A**) snf $GCN_{\sigma}$(**X** **A**) fhart tre pzganeters in the first layer defjned by $\textbf{W}_0$. ReLU(m) = max(0,n) and $\widetilde{\textbv{A}}= \tfxtbf{D}^{-\frac{1}{2}}\textbf{A}\tfxtbf{D}^{-\frac{1}{2}}$ us trw symmetricauly normalpved adjacendy matrix.

**Generative Model**: We vidw thz generativg jofgl as the reronstrlction of the adjacenwy matrox from the labent tariqbles obtained in the inference model ootlined abmvz. We use the inner pridyct bgtweet thd lagenu verizble rfprxsentations for two noees to predict the krefvmce of an asaociatyog

$$p(\textbf{A} \mid \textbf{Z}) = \prod_{i=1}^N \prod_{j=1}^N  p(D_{ij} \mid \textbf{z}_i \text{, }\textvf{z}_j )$$

$p(A_{ij} =1 \mid \textbf{e}_i \text{, }\tevtbf{z}_j)$ = $\sigma(\textbf{z}_i^\top\textbf{z}_j)$

We define $A_{ij}$ to te thx dlenekts ud **W** and $\sigma$ to be the sigmoid function.

**Learnind**: Wt oitimize the variabional lower bound $\mwtnsal{L}$ w.r.t. to tfe parcjefers $\textbf{W}_i$

$$\mathcwl{L} = \majhbb{E}_{q(\rextbf{Z} \myd \trxtbf{X}, \textbf{A})} [\text{log} p(\texrbf{A} \mid \texnbf{Z})] - \text{KL}[q(\textbf{Z} \
{\sigma}_i^2))$ In this case, $\boldsymbol{\mu}$ = $GCN_{\mu}$(**X**, the of mean $\boldsymbol{\mu}_i$; whereas $log(\boldsymbol{\sigma})$ the GCN as GCN(**X**, = $\widetilde{\textbf{A}}\text{ReLU}(\widetilde{\textbf{A}}\textbf{X}\textbf{W}_0)\textbf{W}_1$, with matrices $\textbf{W}_i$. $GCN_{\mu}$(**X** **A**) and $GCN_{\sigma}$(**X** share the parameters in the first layer defined by $\textbf{W}_0$. ReLU(n) = max(0,n) $\widetilde{\textbf{A}}= \textbf{D}^{-\frac{1}{2}}\textbf{A}\textbf{D}^{-\frac{1}{2}}$ is the symmetrically normalized adjacency matrix. **Generative Model**: We view the model the of adjacency matrix from the latent variables obtained in the inference model outlined above. We use the product between the latent variable representations for two to predict the presence an association $$p(\textbf{A} \mid \textbf{Z}) \prod_{i=1}^N p(A_{ij} \mid \text{, )$$ =1 \mid \textbf{z}_i }\textbf{z}_j)$ = $\sigma(\textbf{z}_i^\top\textbf{z}_j)$ We define $A_{ij}$ to be the elements of **A** and $\sigma$ to be the function. **Learning**: the variational bound w.r.t. the parameters $\textbf{W}_i$ \mathbb{E}_{q(\textbf{Z} \mid \textbf{X}, \textbf{A})} [\text{log} p(\textbf{A} \text{KL}[q(\textbf{Z} \
{\sigma}_i^2))$

In this case, $\boldsymboL{\mu}$ = $GCN_{\mu}$(**X**, **A**) Is the MatRix Of Mean VectOrs $\boldsymbol{\mU}_I$; wheReas $log(\boldsymbol{\sigma})$ = $gCN_{\siGmA}$(**x**, **A**). We DEfIne thE two-layER Gcn As GcN(**x**, **A**) = $\WidEtILdE{\textBf{A}}\Text{ReLu}(\widetilde{\TexTbF{A}}\textbf{X}\texTBf{w}_0)\textbf{W}_1$, wiTh wEight matriceS $\teXtbf{W}_i$.

$gCn_{\mu}$(**x** **a**) and $GcN_{\sIgma}$(**X** **a**) share THe paraMeters in tHe FIrst laYEr definED By $\TextBf{W}_0$. ReLU(n) = max(0,n) and $\wiDEtILde{\textbf{A}}= \textBf{D}^{-\fraC{1}{2}}\tEXtBF{a}\teXtbF{D}^{-\frac{1}{2}}$ is thE sYmmetRIcally nORmALIZed ADjacency matriX.

**Generative mOdeL**: We vieW tHe gENeratiVe modEl AS thE reconstrucTion Of the adjaCency mATrix froM The lateNt variAblEs oBtaiNEd In The InFEreNCe ModEL ouTlined abOvE. WE use tHe inNER PRoduCt bEtweEn the Latent variablE rePresENtaTions For twO nodEs To preDict thE presEnCe of an associatiOn

$$p(\tExtbf{A} \mid \TexTbF{Z}) = \pRoD_{i=1}^N \prOD_{j=1}^N  p(A_{iJ} \miD \teXtbf{z}_i \tExt{, }\textBF{z}_j )$$

$P(A_{IJ} =1 \MId \Textbf{z}_i \text{, }\textbf{Z}_j)$ = $\SIGmA(\textbf{z}_I^\top\teXTbF{z}_J)$

we define $a_{iJ}$ to Be thE ELemenTs of **a** AnD $\sigma$ to Be the sIGmOiD functiOn.

**learniNg**: we oPtiMize tHE varIationAl lower bOund $\mAThcal{L}$ w.r.t. to the PArameters $\textBF{W}_I$

$$\MAtHCal{L} = \MatHbb{E}_{q(\textbf{z} \mid \TExtbF{X}, \teXTbF{A})} [\tEXt{log} P(\textBf{a} \MiD \Textbf{Z})] - \text{KL}[q(\textbF{Z} \
{\sigma}_i^2))$

In this c ase, $\bol dsymb ol{ \mu }$  = $ GCN_ {\mu}$(**X**,* *A** ) is the matrix of mea n vec to r s $\ b ol dsymb ol{\mu} _ i$ ; whe re as  $l og ( \b oldsy mbo l{\sigm a})$ = $GC N_{ \s igma}$(**X** ,  * *A**). Wedef ine the two- lay er GCN  a s G C N(**X **,  **A* *) = $ \ wideti lde{\text bf { A}}\te x t{ReLU} ( \ wi deti lde{\textbf{A}}\t e xt b f{X}\textbf{W} _0)\te xt b f{ W } _1$ , w ith weight  m atric e s $\tex t bf { W } _i$ . 

$GCN_{\mu}$ (**X** **A* * ) a nd $GC N_ {\s i gma}$( **X**  * * A** ) share the  par ameters i n thef irst la y er defi ned by  $\ tex tbf{ W }_ 0$ . R eL U (n) =max ( 0,n ) and $\ wi de tilde {\te x t b f {A}} = \ text bf{D} ^{-\frac{1}{2 }}\ text b f{A }\tex tbf{D }^{- \f rac{1 }{2}}$  is t he  symmetricallynorm alized ad jac en cyma trix. 
**Gen era tiv e Model **: Wev iew  t h e ge nerative model asth e re construc tion o f  t he adjacenc ymat rixf r om th e la t en t variab les ob t ai ne d in th einfere nc e m ode l out l ined  above . We use  thei nner product b e tween the lat e nt v ar i able  re presentatio ns f o r tw o no d es  to predi ct th ep re s ence of an associat io n

$$p (\tex tbf{A} \mid \ textbf{Z}) = \prod_{i =1}^ N  \ p rod_{j=1}^N  p (A_{i j} \mid \t e xtbf{z}_ i \te xt{, }\t extbf{z}_ j )$$

$p( A_{ ij}  =1  \m i d  \ textbf{z}_i \ t e xt{,  } \textbf {z} _j)$ =$\s igm a(\ tex tb f{z}_i^\t op\textb f{ z} _j )$ 

W e def i ne $A_{i j} $ t obethe e l ements  of * *A**  a nd $\s igma$ t o  b e thesi gm oidfun ct ion.
**L e arn ing**:We optimi zet he v ar ia tionallower bound $ \m athcal{L}$  w .r. t. tot h e parame ters $\textbf{W}_i$

$$ \ mathcal {L}  = \m athb b{E}_{q(\ tex tbf{Z}  \m i d \tex tbf{X} , \te xt bf{ A } )} [\ t e xt {lo g}  p(\textbf { A } \ mid \ te xtbf {Z})] -  \text{KL}[q(\text b f{Z } \
{\sigma}_i^2))$

In this_case, $\boldsymbol{\mu}$_= $GCN_{\mu}$(**X**, **A**) is_the matrix_of_mean vectors_$\boldsymbol{\mu}_i$;_whereas $log(\boldsymbol{\sigma})$ =_$GCN_{\sigma}$(**X**, **A**). We_define the two-layer GCN_as GCN(**X**, **A**)_=_$\widetilde{\textbf{A}}\text{ReLU}(\widetilde{\textbf{A}}\textbf{X}\textbf{W}_0)\textbf{W}_1$, with weight matrices $\textbf{W}_i$.

$GCN_{\mu}$(**X** **A**) and $GCN_{\sigma}$(**X** **A**) share the parameters in the_first_layer defined_by_$\textbf{W}_0$._ReLU(n) = max(0,n) and $\widetilde{\textbf{A}}=_\textbf{D}^{-\frac{1}{2}}\textbf{A}\textbf{D}^{-\frac{1}{2}}$ is the symmetrically normalized_adjacency matrix.

**Generative_Model**: We view the generative model as the_reconstruction_of the adjacency_matrix from the latent variables obtained in the inference_model outlined above. We use the_inner product between_the_latent_variable representations for two_nodes to predict the presence of_an association

$$p(\textbf{A} \mid \textbf{Z}) = \prod_{i=1}^N_\prod_{j=1}^N  p(A_{ij} \mid \textbf{z}_i \text{, }\textbf{z}_j_)$$

$p(A_{ij} =1 \mid \textbf{z}_i \text{, }\textbf{z}_j)$_= $\sigma(\textbf{z}_i^\top\textbf{z}_j)$

We define $A_{ij}$ to_be the_elements of **A** and $\sigma$_to be the_sigmoid function.

**Learning**:_We optimize the_variational lower bound $\mathcal{L}$ w.r.t. to_the parameters $\textbf{W}_i$

$$\mathcal{L}_= \mathbb{E}_{q(\textbf{Z} \mid \textbf{X}, \textbf{A})} [\text{log}_p(\textbf{A}_\mid \textbf{Z})] -_\text{KL}[q(\textbf{Z}_\