; @Oramas2017]. However, in many cases sequential data, such as user purchase and browsing history, which carries information about trends in user tastes, have largely been neglected in CF-based recommender systems.

![[**Auxiliary information usage in recommender systems.**]{} *Item descriptions and user profiles are typically being used for feature extraction to alleviate the data sparsity problem. Our proposal also leverages sequential data, such as purchase histories, to reflect user preferences.*[]{data-label="fig:auxiliary_usage"}](heterogeneous2recommender.png){width="\columnwidth"}

In this paper we propose Deep Heterogeneous Autoencoders (DHA) for Collaborative Filtering to combine information from multiple domains. We use Stacked Denoising Autoencoders (SDAE) to extract latent features from non-sequential data, and Recurrent Neural Network Encoder-Decoders (RNNED) to extract features from sequential data. The model is able to capture both user preferences and potential shifts of interest over time. Each data source is modeled using an independent encoder-decoder mechanism. Different encoders can have different number of hidden layers and an arbitrary number of hidden units in order to deal with the intrinsic difference of data sources. For instance, user demographic data and item content are typically categorical, while user comments or item tags are textual. After pre-processing, such as one hot encoding, bag-of-words and word2vec computation, representation vectors are on a different level of abstraction. Owing to its flexible structure, our model is able to learn suitable latent feature vectors for each component. These local representations from each data source are joined to form a shared feature space, which couples the joint learning of the representation from heterogeneous data and the collaborative filtering of user-item relationships.

The contributions of this paper are summarized as follows:

1.  A method for modeling both static and sequential data in a consistent way for recommender systems in order to capture the trend in user tastes, and

2.  Adaptation of the autoencoder architecture to accurately model each data source by considering their distinct abstraction levels.

We show improvements in terms of mean average precision and recall on three different datasets.

Related work
============

Incorporating side information into recommender systems
-------------------------------------------------------

In order to improve recommendation performance, research has been focusing on using side information, such as user profiles and reviews [@Fuzheng2016;
; @Oramas2017 ]. However, in many cases sequential data, such as user leverage and browse history, which carries information about drift in drug user tastes, have largely been neglected in cystic fibrosis - base recommender systems. 

! [ [ * * Auxiliary information usage in recommender system. * * ] { } * Item descriptions and user profiles are typically being used for feature origin to alleviate the data sparsity trouble. Our proposal also leverages sequential data, such as leverage histories, to chew over user preferences.*[]{data - label="fig: auxiliary_usage"}](heterogeneous2recommender.png){width="\columnwidth " } 

 In this paper we propose Deep Heterogeneous Autoencoders (DHA) for Collaborative Filtering to combine data from multiple domains. We use Stacked Denoising Autoencoders (SDAE) to extract latent features from non - sequential data, and Recurrent Neural Network Encoder - Decoders (RNNED) to extract features from sequential data. The model is able to capture both user preferences and potential shifts of interest over clock time. Each data source is model use an independent encoder - decoder mechanism. Different encoders can have different number of hidden layers and an arbitrary numeral of hidden units in order to deal with the intrinsic difference of data source. For instance, user demographic data and item content are typically categorical, while exploiter comments or item tags are textual. After pre - processing, such as one hot encoding, bag - of - word and word2vec computation, representation vectors are on a unlike level of abstractedness. Owing to its flexible structure, our model is able to learn desirable latent feature vectors for each component. These local representations from each data beginning are joined to shape a shared feature of speech space, which couples the joint learning of the theatrical performance from heterogeneous data and the collaborative filtering of user - item relationships. 

 The contributions of this paper are summarized as follows: 

 1.   A method for modeling both static and consecutive data in a consistent manner for recommender systems in order to capture the trend in user tastes, and 

 2.   Adaptation of the autoencoder architecture to accurately model each datum source by considering their distinct abstraction levels. 

 We show improvements in terms of base modal precision and recall on three different datasets. 

 Related work 
 = = = = = = = = = = = = 

 Incorporating side data into recommender systems 
 ------------------------------------------------------- 

 In order to improve recommendation performance, research has been focusing on using side information, such as user profile and reviews   [ @Fuzheng2016;
; @Orwmas2017]. However, in many casts sequential datc, such es user purchasd and browsing history, which cqrriew information about trdnds in uder tastws, heve largely been neglectcb in DN-baseb cecommender sysjems.

![[**Auxiliarf information gsxgz in recommender systems.**]{} *Item descri[tions snf user profilef art trpiczlly being used for feature extracfion to alleviate thr data sparsity problem. Oug prlposal also leverahes sequentual qqta, such as ourchase hpvtories, to reflect user preferences.*[]{data-lacel="fiy:auxiliary_uwate"}](hfjerogeneous2rxcommegder.png){width="\gplumnwhdth"}

In yhis paper we iropove Eeep Heterogeneous Auvoencoders (DHA) for Cjllaborathvz Filtering to combinw unforkatimn ffim ouluipke domaijs. Xe use Stacied Denoisibg Autoencoders (SDAT) tj extract lateht feaeuwes from non-sequential data, and Recurrett Heural Network Encoder-Dwcoders (RNNED) to extrwct featuwes from sequential data. The model is able to capdure uogh bwer pfwffrences and potential shifts of interest over fike. Each data souvce is modeled usimg am independent gncoder-bsckder mechanism. Difverent gncodees can hade dofferent number of hidden lqyers and an qrbitrary number oy hidden unics in prder to deal with the intriusic djfference ov data sohfces. For instancd, uxes demographic data and itei content are typicauly vategowical, whilf usev comments or item hags cre taxtual. Aftfr pre-processing, such as one hov encoding, bab-ox-wogds and wjrd2veg computation, rqpresentation rectors cre on a differeht leven of abstrastion. Owing tm its flexiblx structuwe, oyr midel is xble to learn xuitable latent fearure vectors for eech zkmponent. These oocql representatipns frjm eech dwda source ara joknea to furm a shareb weatire space, which coupnes fhe joint learning on the reptesentatijn from heterpgeneous data and uhe conlauoratife siltering of user-item relationahips.

The fonbributions of thiw paper are xummarized as follows:

1.  A method for modxling both static and swquential data in a gonsistent wey for recommenger systems in order to capture the tvend in user tastes, ans

2.  Ada[tatiln of the autoencoder architecture to accurately model each data source bt consmdqring their disyinct aystxaction levxlr.

We show improvekents in terms of mean average 'recision dnb recall on three different dstxsets.

Related dork
============

Incorporating side ihformatipn into recommender systems
-------------------------------------------------------

In otder to improve recommencation pwrforjance, ggseerch has been focusimg on bsing wide indormwtion, such as usrr profiles and rzviews [@Fuzheng2016;
; @Oramas2017]. However, in many cases sequential as purchase and history, which carries tastes, largely been neglected CF-based recommender systems. information usage in recommender systems.**]{} *Item and user profiles are typically being used for feature extraction to alleviate the sparsity problem. Our proposal also leverages sequential data, such as purchase histories, to user In paper propose Deep Heterogeneous Autoencoders (DHA) for Collaborative Filtering to combine information from multiple domains. We use Denoising Autoencoders (SDAE) to extract latent features from data, and Recurrent Neural Encoder-Decoders (RNNED) to extract features sequential The model able capture user preferences and shifts of interest over time. Each data source is modeled using an independent encoder-decoder mechanism. Different encoders have different hidden layers an number hidden units in deal with the intrinsic difference of instance, user demographic data and item content are categorical, while comments or item tags are textual. pre-processing, such as one hot encoding, bag-of-words and computation, representation vectors are on a different level of abstraction. Owing to its flexible structure, is able to learn latent feature vectors each These representations each data are joined to form a shared feature space, which couples the learning of the representation from heterogeneous data and the collaborative user-item The contributions of paper are summarized as 1. method for modeling both sequential in for systems order to capture the in user tastes, and 2. of the autoencoder architecture source by considering their distinct abstraction levels. We improvements in terms of mean average precision recall on three different datasets. Related work ============ Incorporating side information into systems ------------------------------------------------------- to improve recommendation performance, research has been focusing using side information, such user profiles and reviews [@Fuzheng2016;
; @Oramas2017]. However, in many cases sEquential dAta, suCh aS usEr PurcHase And browsing hisTOry, wHich carries information About TrENds iN UsEr tasTes, have LArGELy bEeN nEglEcTEd In CF-bAseD recommEnder systeMs.

![[**AUxIliary informATiOn usage in rEcoMmender systeMs.**]{} *ITem desCrIptIOns anD usEr proFiles aRE typicAlly being UsED for feATure extRACtIon tO alleviate the data SPaRSity problem. Our ProposAl ALsO LEveRagEs sequentiAl Data, sUCh as purCHaSE HIstORies, to reflect User prefereNCes.*[]{Data-laBeL="fiG:AuxiliAry_usAgE"}](HetErogeneous2rEcomMender.png){Width="\cOLumnwidTH"}

In this Paper wE prOpoSe DeEP HEtEroGeNEouS auToeNCodErs (DHA) foR COlLaborAtivE fILTeriNg tO comBine iNformation froM muLtipLE doMains. we use stacKeD DenoIsing AUtoenCoDers (SDAE) to extraCt laTent featuRes FrOm nOn-SequeNTial daTa, aNd REcurrenT Neural nEtwOrK eNCoDer-Decoders (RNNED) to ExTRAcT featureS from sEQuEnTIal data. THe ModEl is ABLe to cAptuRE bOth user pRefereNCeS aNd potenTiAl shifTs Of iNteRest oVEr tiMe. Each Data sourCe is mODeled using an inDEpendent encodER-dECOdER mecHanIsm. DifferenT encODers Can hAVe DifFErent NumbeR oF HiDDen layers and an arbitRaRy numbEr of hIdden units in oRder to deal WITH the intrInsiC DiFFerence of data sOurceS. For instanCE, user demOgrapHic data aNd item conTENt are typIcaLly CatEgoRICaL, while user comMENts oR iTem tags Are Textual. aftEr pRe-pRocEsSing, such aS one hot eNcOdInG, bAg-oF-wordS And word2vEc ComPuTatIon, rePResentAtion VectOrS aRE on A differENt LEVel oF aBsTracTioN. OWing tO its FLexIble strUcture, our ModEL is aBlE tO learn sUitable latent FeAture vectoRs For Each coMPOnent. TheSe local representations fROm each dAta SourcE are Joined to fOrm A shareD feATure spAce, whiCh couPlEs tHE Joint LEArNinG oF the represENTatIon frOm HeteRogeneoUs data and the collabORatIve filtering oF usEr-itEM ReLatIOnSHipS.

THE coNTRibutions of this Paper are suMmARiZed as folloWS:

1.  A mEtHod for mOdeling Both sTAtic and SequentiaL data in a cOnSistENT waY for recommEnder sysTems in ordER to caPTuRe the TreNd in usEr TasTes, anD

2.  AdaptATioN of thE autoeNcOder arChiteCtUre to accUrately model each data souRce by cOnsidEriNg their diStiNCt aBstractioN levEls.

We show iMprOveMents In tERms of Mean AVeRagE PreciSion ANd recall oN ThRee DIFfErent dataseTS.

rElaTed woRk
============

INCorporAtinG side information iNTo recommender sYsteMS
-------------------------------------------------------

in oRdeR To imPrOve recommendatIon PeRFOrmance, rEsEarch has beeN focusinG oN Using Side inFormatIon, such AS UsER profiLes aNd rEviews [@FuzHenG2016;
; @Oramas2017]. However, i n many cas es se que nti al  dat a, s uch as user pu r chas e and browsing history , whi ch carr i es  info rmation ab o u t t re nd s i nu se r tas tes , havelargely be enne glected in C F -b ased recom men der systems. 

! [[**Au xi lia r y inf orm ation  usage in rec ommendersy s tems.* * ]{} *It e m  d escr iptions and userp ro f iles are typic ally b ei n gu s edfor  feature e xt racti o n to al l ev i a t e t h e data sparsi ty problem. Our  propo sa l a l so lev erage ss equ ential data , su ch as pur chaseh istorie s , to re flectuse r p refe r en ce s.* [] { dat a -l abe l ="f ig:auxil ia ry _usag e"}] ( h e t erog ene ous2 recom mender.png){w idt h="\ c olu mnwid th"}
Inth is pa per we  prop os e Deep Heteroge neou s Autoenc ode rs  (D HA ) for Collab ora tiv e Filte ring to com bi n e in formation from mul ti p l edomains.  We us e  S ta c ked Deno is ing  Aut o e ncode rs ( S DA E) to ex tractl at en t featu re s from  n on- seq uenti a l da ta, an d Recurr ent N e ural Network E n coder-Decoder s  ( R N NE D ) to  ex tract featu resf romsequ e nt ial data.  Themo d el is able to capturebo th use r pre ferences andpotentials h i fts of i nter e st over time. Eac h dat a source i s  modeled  usin g an ind ependente n coder-de cod ermec han i s m.  Different en c o ders  c an have  di fferent  nu mbe r o f h id den layer s and an  a rb it ra rynumbe r  of hidd en  un it s i n ord e r to d eal w ithth ei ntr insic d i ff e r ence  o fdata  so ur ces.Fori nst ance, u ser demog rap h ic d at aand ite m content are  t ypically c at ego rical, w hile use r comments or item tags are tex tua l. Af terpre-proce ssi ng, su cha s onehot en codin g,  ba g - of-wo r d sand  w ord2vec co m p uta tion,  r epre sentati on vectors are ona  di fferent level  of  abs t r ac tio n .O win gt o i t s  flexible struc ture, ourmo d el  is able t o  le ar n suita ble lat ent f e ature v ectors fo r each co mp onen t .  Th ese localrepresen tations f r om ea c hdatasou rce ar ejoi ned t o form a s hared  featu re  space , whi ch  couples  the joint learning ofthe re prese nta tion from  he t ero geneous d ataand the co lla bor ative  fi l terin g of us er- i tem r elat i onships.Th e c o n tr ibutions of t h ispaper  ar e  summa rize d as follows:

1.  A method formode l i ngbot h  sta ti c and sequenti alda t a  in a co ns istent wayfor reco mm e ndersystem s in o rder to c ap t ure th e tr end  in usertas te s , and
2.  A daptat ionof  the a utoenc o dera r chitecture to ac curat e l y mod e l e ach d at a sourc e  byconsiderin g their dis tinctabst racti on leve ls .

Wesho wimprovemen t s in term s ofmean av er agepre cision  and r ecall  onth ree  differen t da t as et s .
Rela ted w or k
== ========= = 

Incorp ora t ing sid einf o r mation in t o  recommend ersyste m s 
--------- - ---- - -- - ----- ------ ------ ------- - --- -- ------- 

I n order toimprove r e com me ndat ion perf or manc e,  re se arch has been f ocusingon using s ide in for m atio n , such  a s user profi les a nd reviews [ @Fu zheng20 1 6;
; @Oramas2017]._However, in_many cases sequential data,_such as_user_purchase and_browsing_history, which carries_information about trends_in user tastes, have_largely been neglected_in_CF-based recommender systems.

![[**Auxiliary information usage in recommender systems.**]{} *Item descriptions and user profiles are_typically_being used_for_feature_extraction to alleviate the data_sparsity problem. Our proposal also_leverages sequential_data, such as purchase histories, to reflect user_preferences.*[]{data-label="fig:auxiliary_usage"}](heterogeneous2recommender.png){width="\columnwidth"}

In_this paper we_propose Deep Heterogeneous Autoencoders (DHA) for Collaborative Filtering to_combine information from multiple domains. We_use Stacked Denoising_Autoencoders_(SDAE)_to extract latent features_from non-sequential data, and Recurrent Neural_Network Encoder-Decoders (RNNED) to extract features_from sequential data. The model is able_to capture both user preferences and_potential shifts of interest over_time. Each_data source is modeled using_an independent encoder-decoder_mechanism. Different_encoders can have_different number of hidden layers and_an arbitrary number_of hidden units in order to_deal_with the intrinsic_difference_of_data sources._For instance, user_demographic_data and_item_content are typically categorical, while user_comments_or item tags are textual. After pre-processing,_such as one hot_encoding,_bag-of-words and word2vec computation,_representation vectors are on a_different level of abstraction. Owing to_its flexible_structure, our_model is able to learn suitable latent feature vectors for each_component. These local representations from each_data source are joined_to form_a_shared feature space,_which_couples the_joint learning of the representation from heterogeneous_data and_the collaborative filtering of user-item relationships.

The_contributions of this paper_are_summarized as follows:

1.  A method_for modeling both static and sequential_data in a consistent way_for_recommender_systems in order to capture_the trend in user tastes, and

2._ Adaptation of_the autoencoder architecture to accurately model each_data_source by considering their distinct abstraction_levels.

We_show improvements in terms of mean_average_precision_and recall on three different_datasets.

Related work
============

Incorporating side information into recommender_systems
-------------------------------------------------------

In order to improve recommendation performance, research has been_focusing on using_side information, such as user_profiles_and_reviews [@Fuzheng2016;