 use one of the most common methods of combining two types of features, which concatenates them together and applies a MLP. As we have mentioned, the combination result, as the new spatial feature, is actually more comprehensive and contains both spatial and structural information. Therefore, in the pipeline of our network, we concatenate all the combination results for generating global feature.

#### Aggregation of Structural Feature

With the input structural feature and neighbor index, we aggregate the feature of a face with features of its connected faces. Several aggregation methods are listed and discussed as follows:

-   **Average pooling:** The average pooling may be the most common aggregation method, which simply calculates the average value of features in each channel. However, this method sometimes weakens the strongly-activated areas of the original features and reduce the distinction of them.

-   **Max pooling:** Another pooling method is the max pooling, which calculates the max value of features in each channel. Max pooling is widely used in 2D and 3D deep learning frameworks for its advantage of maintaining the strong activation of neurons.

-   **Concatenation:** We define the concatenation aggregation, which concatenates the feature of face with feature of each neighbor respectively, passes these pairs through a shared MLP and applies a max pooling to the results. This method both keeps the original activation and leaves space for the network to combine neighboring features.

We finally use the concatenation method in this paper. After aggregation, another MLP is applied to further fusion the neighboring features and output new structural feature.

Implementation Details
----------------------

Now we present the details of implementing MeshNet, illustrated in Fig 2, including the settings of hyper-parameters and some details of the overall architecture.

The spatial descriptor contains fully-connected layers (64, 64) and output a initial spatial feature with length of 64. Parameters inside parentheses indicate the dimensions of layers except the input layer. In the face rotate convolution, we set $K_1=32$ and $K_2 = 64$, and correspondingly, the functions $f(\cdot, \cdot)$ and $g(\cdot)$ are implemented by fully-connected layers (32, 32) and (64, 64). In the face kernel correlation, we set $M = 64$ (64 kernels) and $\sigma = 0.2$.

We parameterize the mesh convolution block with a four-tuple $(in_1, in_2, out_1,
use one of the most common methods of compound two type of features, which concatenates them together and apply a MLP. As we have mentioned, the combination result, as the modern spatial feature of speech, is actually more comprehensive and contains both spatial and structural information. Therefore, in the pipeline of our net, we concatenate all the combination results for generating global feature. 

 # # # # collection of Structural Feature 

 With the input structural feature and neighbor index, we aggregate the feature of a expression with features of its connected faces. respective aggregation methods are number and discussed as come: 

 -    * * Average pooling :* * The average pooling may be the most common aggregation method acting, which simply calculates the average value of features in each channel. However, this method sometimes de-escalate the powerfully - activated areas of the original features and reduce the distinction of them. 

 -    * * Max pooling :* * Another pooling method is the max pooling, which calculates the soap value of features in each distribution channel. Max pooling is widely used in 2D and 3D deep memorize frameworks for its advantage of maintaining the strong energizing of neurons. 

 -    * * chain :* * We define the concatenation aggregation, which concatenate the feature of face with feature of each neighbor respectively, passes these pairs through a shared MLP and applies a max pooling to the results. This method both keeps the original activation and bequeath outer space for the network to combine neighboring features. 

 We finally use the chain method in this paper. After aggregation, another MLP is applied to further fusion the neighboring features and output new structural feature. 

 Implementation Details 
 ---------------------- 

 immediately we present the detail of implementing MeshNet, exemplify in Fig 2, including the setting of hyper - parameters and some contingent of the overall architecture. 

 The spatial form contains fully - connected layer (64, 64) and output a initial spatial feature with distance of 64. Parameters inside parentheses indicate the dimensions of layers except the input layer. In the face rotate convolution, we put $ K_1=32 $ and $ K_2 = 64 $, and correspondingly, the functions $ f(\cdot, \cdot)$ and $ g(\cdot)$ are implemented by in full - connected layers (32, 32) and (64, 64). In the font kernel correlation, we set $ M = 64 $ (64 kernel) and $ \sigma = 0.2$. 

 We parameterize the mesh convolution block with a four - tuple $ (in_1, in_2, out_1,
 usf one of the most common methods of comyuning vwo typss of fextures, which concatenates thxm tigethtg and applies a MLP. Ar we have mentionwd, tie combination rxault, as the nsa spctmal feature, is sctually mmre comprehenshvd cnd contains both spatial and structtral ingogmation. Therefjre, pn the iikeline of our network, we concatenzte all the combinatoon results for generating glohal feature.

#### Aggregwtion of Stthctteal Feature

Wkth the inkuc structuram feature and neighbor index, we aggrzgate the fgcrurf of a face xith fvatures of its connecded facrs. Several aggvegatmon nethods are listed anv discussed as follors:

-   **Averdgz pooling:** The average piolinc maf be rhe moat ckmmon wggcegation mefhod, which wimply calculates tne qverage value of fewttres in each channel. However, this methog skmetimes weakens the steongly-activated areas of the owiginal features and reduce the distinction of tham.

-   **Jxx koiling:** Qnlther pooling method is the max pooling, which dakcllates the max vajue of featirfs yn each channgl. Max 'koming is widely usef in 2D wnd 3D deep leawninb frameworks for its advantqge of maintcinung the strong actnvation of nzurons.

-   **Comcatenation:** We define tke condatenation wggregatikv, which concatenxtex dhe feature of face with fqature of eack neighbur rgspectidely, passed these pairs through a dhareb MLP and applifs a max pooling to the results. This method bptv kveps the jrigikal activation wnd leaves spaee for tke netdork to cojbine nxighboring fqatures.

We findply use the roncatenaeion metyod in gfis paper. Aftet aggreganijn, abother MLP is applled tu further fusion tht beighboring festufes ajd otdput new strgctufal geatufe.

Implementctkon Cetails
----------------------

Now we presend ths details of implekekting MesyNet, illtstrated in Fog 2, including the dettiigs of hypet-patameters and some details of ths overall arghitecture.

The spabial descriptox contains fully-connected layers (64, 64) and ontput a initial spatial feature with lengtk pf 64. Parametxrs infide parettheses indicate the dimensions of laners except the input mayer. Hn thf face rotate convolution, we set $K_1=32$ and $K_2 = 64$, and correspondingly, the functiins $f(\cvoe, \cdot)$ and $f(\cdoy)$ are ii'lementqd bb hully-connected lajers (32, 32) and (64, 64). In the face kernel rorrelatiot, ce set $M = 64$ (64 kernels) and $\sigma = 0.2$.

De parameteriee the mesh convolution blkck with a four-tuple $(in_1, in_2, out_1,
use one of the most common methods two of features, concatenates them together we mentioned, the combination as the new feature, is actually more comprehensive and both spatial and structural information. Therefore, in the pipeline of our network, we all the combination results for generating global feature. #### Aggregation of Structural Feature the structural and index, we aggregate the feature of a face with features of its connected faces. Several aggregation are listed and discussed as follows: - **Average The average pooling may the most common aggregation method, simply the average of in channel. However, this sometimes weakens the strongly-activated areas of the original features and reduce the distinction of them. - **Max Another pooling the max which the value of features channel. Max pooling is widely used 3D deep learning frameworks for its advantage of the strong of neurons. - **Concatenation:** We define concatenation aggregation, which concatenates the feature of face feature of each neighbor respectively, passes these pairs through a shared MLP and applies a to the results. This both keeps the activation leaves for network to neighboring features. We finally use the concatenation method in this paper. aggregation, another MLP is applied to further fusion the neighboring output structural feature. Implementation ---------------------- Now we present details implementing MeshNet, illustrated in including settings some of overall architecture. The spatial contains fully-connected layers (64, 64) output a initial spatial Parameters inside parentheses indicate the dimensions of layers the input layer. In the face rotate we set $K_1=32$ and $K_2 = 64$, and correspondingly, the functions $f(\cdot, and $g(\cdot)$ by fully-connected layers (32, 32) and (64, 64). the face kernel correlation, set $M = 64$ (64 kernels) and $\sigma = We the mesh block with a $(in_1, in_2, out_1,
 use one of the most common methOds of combiNing tWo tYpeS oF feaTureS, which concatenATes tHem together and applies a mLP. As We HAve mENtIoned, The combINaTIOn rEsUlT, as ThE NeW spatIal Feature, Is actually MorE cOmprehensive ANd Contains boTh sPatial and strUctUral inFoRmaTIon. ThEreFore, iN the piPEline oF our netwoRk, WE concaTEnate alL THe CombInation results for GEnERating global feAture.

#### AGgREgATIon Of STructural FEaTure

WITh the inPUt STRUctURal feature and Neighbor indEX, we AggregAtE thE FeaturE of a fAcE WitH features of Its cOnnected fAces. SeVEral aggREgation MethodS arE liSted ANd DiScuSsED as FOlLowS:

-   **aveRage poolInG:** THe aveRage POOLIng mAy bE the Most cOmmon aggregatIon MethOD, whIch siMply cAlcuLaTes thE averaGe valUe Of features in eacH chaNnel. HowevEr, tHiS meThOd somETimes wEakEns The stroNgly-actIVatEd AREAs Of the original featuReS ANd Reduce thE distiNCtIoN Of them.

-   **MaX pOolIng:** ANOTher pOoliNG mEthod is tHe max pOOlInG, which cAlCulateS tHe mAx vAlue oF FeatUres in Each chanNel. MaX Pooling is widelY Used in 2D and 3D deEP lEARnINg frAmeWorks for its AdvaNTage Of maINtAinINg the StronG aCTiVAtion of neurons.

-   **ConcaTeNation:** we defIne the concateNation aggrEGATion, whicH conCAtENates the featurE of faCe with featURe of each NeighBor respeCtively, paSSEs these pAirS thRouGh a SHArEd MLP and appliES A max PoOling to The Results. thiS meThoD boTh Keeps the oRiginal aCtIvAtIoN anD leavES space foR tHe nEtWorK to coMBine neIghboRing FeAtURes.

we finalLY uSE The cOnCaTenaTioN mEthod In thIS paPer. AfteR aggregatIon, ANothEr mLp is applIed to further fUsIon the neigHbOriNg featUREs and outPut new structural feature.

iMplemenTatIon DeTailS
----------------------

Now we preSenT the deTaiLS of impLementIng MeShnet, ILLustrATEd In FIg 2, Including tHE SetTings Of HypeR-parameTers and some details OF thE overall archiTecTure.

tHE sPatIAl DEscRiPTor CONtains fully-connEcted layerS (64, 64) aND oUtput a initIAl sPaTial feaTure witH lengTH of 64. ParaMeters insIde parentHeSes iNDIcaTe the dimenSions of lAyers excePT the iNPuT layeR. In The facE rOtaTe conVolutiON, we Set $K_1=32$ aNd $K_2 = 64$, and CoRrespoNdingLy, The functIons $f(\cdot, \cdot)$ and $g(\cdot)$ arE impleMenteD by Fully-connEctED laYers (32, 32) and (64, 64). In The fAce kernel cOrrElaTion, wE seT $m = 64$ (64 kernEls) aND $\sIgmA = 0.2$.

we parAmetERize the meSH cOnvOLUtIon block witH A FOur-Tuple $(In_1, iN_2, Out_1,
 use one of the most commo n methodsof co mbi nin gtwotype s of features, whic h concatenates them to gethe ra nd a p pl ies a  MLP. A s  w e hav eme nti on e d,  thecom binatio n result,asth e new spatia l  f eature, is  ac tually morecom prehen si vea nd co nta ins b oth sp a tial a nd struct ur a l info r mation. T he refo re, in the pipeli n eo f our network,  we co nc a te n a teall  the combi na tionr esultsf or g e ner a ting global f eature.

## # # A ggrega ti ono f Stru ctura lF eat ure

With t he i nput stru ctural feature and nei ghborind ex,  wea gg re gat et hef ea tur e  of  a facewi th  feat ures o f itscon nect ed fa ces. Severalagg rega t ion  meth ods a re l is ted a nd dis cusse das follows:

-  ** Average p ool in g:* *The a v eragepoo lin g may b e the m o stco m m o naggregation method ,w h ic h simply  calcu l at es the aver ag e v alue o f fea ture s  i n each c hannel .  H ow ever, t hi s meth od  so met imesw eake ns the  strongl y-act i vated areas of the originalf ea t u re s  and  re duce the di stin c tion  oft he m.-   * *Maxpo o li n g:** Another poolin gmethod  is t he max poolin g, which c a l c ulates t he m a xv alue of featur es in  each chan n el. Maxpooli ng is wi dely used i n 2D and  3D  de eplea r n in g frameworksf o r it sadvanta geof main tai nin g t hest rong acti vation o fne ur on s.
-  * *Concate na tio n: **We de f ine th e con cate na ti o n a ggregat i on , whic hco ncat ena te s the  fea t ure  of fac e with fe atu r e of  e ac h neigh bor respectiv el y, passesth ese  pairs t hrough a  shared MLP and applies a max p ool ing t o th e results . T his me tho d  bothkeepsthe o ri gin a l  acti v a ti onan d leaves s p a cefor t he  net work to  combine neighbori n g f eatures.

Wefin ally u se  th e  c o nca te n ati o n  method in this  paper. Af te r  a ggregation ,  an ot her MLP  is app liedt o furth er fusion  the neig hb orin g fea tures andoutput n ew struct u ral f e at ure.
Im plemen ta tio n Det ails
- - --- ----- ------ -- ----
Now w epresentthe details of implemen ting M eshNe t,illustrat edi n F ig 2, inc ludi ng the set tin gsof hy per - param eter s  a nds ome d etai l s of theo ve ral l ar chitecture. T hespati ald escrip torcontains fully-co n nected layers(64, 6 4)and outp ut  a initial spa tia lf e ature wi th  length of64. Para me t ers i nsideparent heses i n d ic a te the  dim ens ions of l aye rs exceptth ei nput l ayer .In the  facer otat e convolution, weset $ K _ 1=32$ and  $K_2  =  64$, a n d co rrespondin gly, the fu nction s $f (\cdo t, \cdo t) $ and$g( \c dot)$ arei mplemente d byfully-c on nect edlayers  (32 , 32) a nd ( 64 , 6 4). In th e fa c eke r nel  cor relat io n, w e set $M=  64$ (64  ke r nels) a nd  $\ s i gma =0 .2 $ . 

We param ete rizet h e mesh con v olut i on block  witha four -tuple$ (in _1 , in_2,  ou t _ 1,
 use_one of_the most common methods_of combining_two_types of_features,_which concatenates them_together and applies_a MLP. As we_have mentioned, the_combination_result, as the new spatial feature, is actually more comprehensive and contains both spatial_and_structural information._Therefore,_in_the pipeline of our network,_we concatenate all the combination_results for_generating global feature.

#### Aggregation of Structural Feature

With the_input_structural feature and_neighbor index, we aggregate the feature of a face_with features of its connected faces._Several aggregation methods_are_listed_and discussed as follows:

-_  **Average pooling:** The average_pooling may be the most common_aggregation method, which simply calculates the average_value of features in each channel._However, this method sometimes weakens_the strongly-activated_areas of the original features_and reduce the_distinction of_them.

-  _**Max pooling:** Another pooling method is_the max pooling,_which calculates the max value of_features_in each channel._Max_pooling_is widely_used in 2D_and_3D deep_learning_frameworks for its advantage of maintaining_the_strong activation of neurons.

-   **Concatenation:**_We define the concatenation_aggregation,_which concatenates the feature_of face with feature of_each neighbor respectively, passes these pairs_through a_shared MLP_and applies a max pooling to the results. This method both_keeps the original activation and leaves_space for the network_to combine_neighboring_features.

We finally use_the_concatenation method_in this paper. After aggregation, another MLP_is applied_to further fusion the neighboring features_and output new structural_feature.

Implementation_Details
----------------------

Now we present the details of_implementing MeshNet, illustrated in Fig 2,_including the settings of hyper-parameters_and_some_details of the overall architecture.

The_spatial descriptor contains fully-connected layers (64,_64) and output_a initial spatial feature with length of_64._Parameters inside parentheses indicate the dimensions_of_layers except the input layer. In_the_face_rotate convolution, we set $K_1=32$_and $K_2 = 64$, and correspondingly,_the functions $f(\cdot, \cdot)$ and $g(\cdot)$ are implemented by_fully-connected layers (32,_32) and (64, 64). In_the_face_kernel correlation, we set $M = 64$ (64 kernels) and_$\sigma =_0.2$.

We parameterize the_mesh convolution block with a four-tuple $(in_1, in_2, out_1,