 likelihood [@stigler2002statistics; @tong1975], (ii) Bayesian [@Strelioff] and (iii) information-theoretic methods [@akaike; @katz; @murphy; @schwarz; @tong1975]. We supplement these with a (iv) cross validation approach for a prediction task [@murphy]. We thoroughly elaborate each method, put them into relation to each other and also highlight strengths and weaknesses of each. Such detailed derivation of model parameters and the model comparison is, for example, missing in previous work [@chierichetti], which prevents us from drawing definite conclusions. We apply these methods to our human navigational data in order to get an exhaustive picture about memory in human navigation. Finally, we identify structural aspects by analyzing transition matrices produced by our Markov chain analyses. ]{}]{}

[**Contributions.**]{} The main contributions of this work are three-fold:

-   First, we deploy four different, yet complementary, approaches for order selection of Markov chain models (likelihood, Bayesian, information-theoretic and cross validation methods) and elaborate their strengths and weaknesses. [[Hence, our work extends existing studies that model human navigation on the Web using Markov chain models [@chierichetti].]{}]{} By applying these methods on navigational Web data, our work presents – to the best of our knowledge – the most comprehensive and systematic evaluation of Markov model orders for human navigational sequences on the Web to date. Furthermore, we make our methods in the form of an open source framework available online[^2] to aid future work [@github].

-   Our empirical results confirm what we inferred from theory: It is difficult to make plausible statements about the appropriate Markov chain order having insufficient data but a vast amount of states, which is a common situation for Web page navigational paths. All evaluation approaches would favor a zero or first order because the number of parameters grows exponentially with the chain order and the available data is too sparse for proper parameter inferences. Thus, we show further evidence that the memoryless model seems to be a quite practical and legitimate model for human navigation on a page level.

-   By abstracting away from the page level to a topical level, the results are different. By representing all datasets as navigational sequences of topics that describe underlying Web pages (cf. Figure \[fig:pathexample\]), we find evidence that topical navigation of humans is not memoryless at all. On three rather different datasets of navigation – free navigation (MSNBC
likelihood [ @stigler2002statistics; @tong1975 ], (ii) Bayesian [ @Strelioff ] and (iii) information - theoretic methods [ @akaike; @katz; @murphy; @schwarz; @tong1975 ]. We supplement these with a (four) thwart validation approach for a prediction task [ @murphy ]. We thoroughly complicate each method, put them into relation to each early and besides highlight strengths and weaknesses of each. Such detailed derivation of model parameter and the model comparison is, for example, miss in previous work [ @chierichetti ], which prevents us from drawing definite conclusions. We apply these method to our human navigational data in order to get an exhaustive video about memory in human navigation. Finally, we identify structural aspect by analyzing transition matrices produced by our Markov chain analysis. ] { } ] { } 

 [ * * Contributions. * * ] { } The main contributions of this work are three - fold: 

 -    First, we deploy four different, yet complemental, approach for order selection of Markov chain models (likelihood, Bayesian, information - theoretic and cross validation methods) and complicate their lastingness and weaknesses. [ [ therefore, our workplace stretch existing studies that model human seafaring on the Web use Markov chain models [ @chierichetti ]. ] { } ] { } By practice these methods on navigational Web data, our work presents – to the best of our knowledge – the most comprehensive and systematic evaluation of Markov model orders for human navigational sequence on the vane to date. Furthermore, we make our methods in the form of an open source model available online[^2 ] to aid future work [ @github ]. 

 -    Our empirical results confirm what we inferred from theory: It is difficult to make plausible statements about the appropriate Markov range order having insufficient data but a vast amount of state, which is a common site for Web page navigational way. All evaluation approaches would privilege a zero or first order because the number of parameters grows exponentially with the range order and the available data is too sparse for proper argument inferences. Thus, we show further evidence that the memoryless model seem to be a quite hardheaded and legitimate model for human seafaring on a page level. 

 -    By abstracting away from the page level to a topical level, the results are different. By defend all datasets as navigational sequences of topics that describe underlying Web pages (californium. name \[fig: pathexample\ ]), we witness evidence that topical navigation of humans is not memoryless at wholly. On three rather different datasets of navigation – complimentary navigation (MSNBC
 linelihood [@stigler2002statistigs; @tong1975], (ii) Bayesnqn [@Strxlioff] znd (iii) knformation-theoretic methods [@ajaike; @katz; @murphy; @schwarz; @tung1975]. We suiplement rhest with a (iv) cross validatljn aliroack hor a predictiok task [@murpvy]. We thoroughny epaborate each method, put them into welatiom ho each other wnd sjso gpgmlight strengths and weaknesses kf each. Such detailec derivation of model paraletegs and the model clmparison iw, fow example, misring in prtvnous work [@cgierichetti], which prevents us ffom dxawing defibire fmnclusions. Xe appjy these metmpds to our hukan navigationsl vata in order to get an eehaustive picture abjut memorf nn human navigation. Funqlly, fe igentkdy rtrhcvurzl aspfcta by analyaing transirion matrices produveq by our Markob chaig wnalyses. ]{}]{}

[**Contributions.**]{} The main contribltiohs of this work are thrwe-fold:

-   First, we deppoy four qifferent, yet complementary, approaches for order velecviun if Oqrnov chain models (likelihood, Bayesian, informatykn-uhepretic and crofs validatipn mrjhods) and elaburate cgejr strengths and wfaknessgs. [[Henxe, our wowk ectends existing studies thar model humau nqvigation on the Wzb using Maryov vhain models [@chierichetti].]{}]{} By appmying these methods kv navigational Wdb cada, our work presents – to tre best oh our knowleage – the mjst comprejensiya and systematic egaluajion ox Markov mldel orders for human navigatioiel sequences pn thv Web to bate. Fmrthermore, we mwke our methodx in thz form of an opeh sourcx framework wvailable onlhje[^2] to aid fuvure work [@gityub].

-   Our eooirical resultx confirm what we ibferred from theorn: It ka difficult to nakt plausible statrmevts ahont thq appropriate Maryov vhain order havikg knsugficient data but a east amount of states, ehlch is a xommon sytuation for Eeb page navigatiojal peths. Aul evsluwtion approaches would favor a zero or virft order becwuse the number pf parameters grows exponentially with vhe chain order and thg available data is tpp sparse foc propqr parameder inferences. Thus, qe show further eyidence that the memorgless kodel seems to be a quite practical and legitimate model for human navigation in a pegq level.

-   Bg abxtracniny acay froi thx 'age level to a tppical level, the results are dihferent. By rzpresenting all datasets as nsvkgational seqoences of topics that descdibe undrrlying Web pages (cf. Figure \[fig:lathexample\]), we find evidcnce that topidal nanjgetion of humans is npt memmrylews at aol. Ok three rather digfcrent datadets oy navigation – free navigation (MSNVC
likelihood [@stigler2002statistics; @tong1975], (ii) Bayesian [@Strelioff] and methods @katz; @murphy; @tong1975]. We supplement validation for a prediction [@murphy]. We thoroughly each method, put them into relation each other and also highlight strengths and weaknesses of each. Such detailed derivation model parameters and the model comparison is, for example, missing in previous work which us drawing conclusions. We apply these methods to our human navigational data in order to get an exhaustive about memory in human navigation. Finally, we identify aspects by analyzing transition produced by our Markov chain ]{}]{} The main of work three-fold: - First, deploy four different, yet complementary, approaches for order selection of Markov chain models (likelihood, Bayesian, information-theoretic and validation methods) their strengths weaknesses. our extends existing studies human navigation on the Web using [@chierichetti].]{}]{} By applying these methods on navigational Web our work – to the best of our – the most comprehensive and systematic evaluation of model orders for human navigational sequences on the Web to date. Furthermore, we make our the form of an source framework available to future [@github]. Our empirical confirm what we inferred from theory: It is difficult to make statements about the appropriate Markov chain order having insufficient data vast of states, which a common situation for page paths. All evaluation approaches a or the of grows exponentially with the order and the available data too sparse for proper further evidence that the memoryless model seems to a quite practical and legitimate model for navigation on a page level. - By abstracting away from the page to a the results are different. By representing all datasets navigational sequences of topics describe underlying Web pages (cf. Figure \[fig:pathexample\]), we find that navigation of is not memoryless all. On three different datasets of free navigation
 likelihood [@stigler2002statistiCs; @tong1975], (ii) BaYesiaN [@StRelIoFf] anD (iii) Information-theORetiC methods [@akaike; @katz; @murpHy; @schWaRZ; @tonG1975]. we SupplEment thESe WITh a (Iv) CrOss VaLIdAtion AppRoach foR a predictiOn tAsK [@murphy]. We thoROuGhly elaborAte Each method, puT thEm into ReLatIOn to eAch Other And alsO HighliGht strengThS And weaKNesses oF EAcH. SucH detailed derivatiON oF Model parameterS and thE mODeL COmpAriSon is, for exAmPle, miSSing in pREvIOUS woRK [@chierichetti], Which prevenTS us From drAwIng DEfinitE concLuSIonS. We apply theSe meThods to ouR human NAvigatiONal data In ordeR to Get An exHAuStIve PiCTurE AbOut MEmoRy in humaN nAvIgatiOn. FiNALLY, we iDenTify StrucTural aspects bY anAlyzINg tRansiTion mAtriCeS prodUced by Our MaRkOv chain analyses. ]{}]{}

[**contRibutions.**]{} the MaIn cOnTribuTIons of ThiS woRk are thRee-fold:

-   fIrsT, wE DEPlOy four different, yet CoMPLeMentary, aPproacHEs FoR Order selEcTioN of MARKov chAin mODeLs (likeliHood, BaYEsIaN, informAtIon-theOrEtiC anD crosS ValiDation Methods) aNd elaBOrate their streNGths and weakneSSeS. [[hEnCE, our WorK extends exiStinG StudIes tHAt ModEL humaN naviGaTIoN On the Web using Markov ChAin modEls [@chIerichetti].]{}]{} By aPplying theSE MEthods on NaviGAtIOnal Web data, our Work pResents – to tHE best of oUr knoWledge – thE most compREHensive aNd sYstEmaTic EVAlUation of MarkoV MOdel OrDers for HumAn navigAtiOnaL seQueNcEs on the WeB to date. FUrThErMoRe, wE make OUr methodS iN thE fOrm Of an oPEn sourCe fraMewoRk AvAIlaBle onliNE[^2] tO AId fuTuRe Work [@GitHuB].

-   Our eMpirICal Results Confirm whAt wE InfeRrEd From theOry: It is difficUlT to make plaUsIblE stateMENts about The appropriate Markov chaIN order hAviNg insUffiCient data But A vast aMouNT of staTes, whiCh is a CoMmoN SItuatION fOr WEb Page navigaTIOnaL pathS. ALl evAluatioN approaches would faVOr a Zero or first orDer BecaUSE tHe nUMbER of PaRAmeTERs grows exponentIally with tHe CHaIn order and THe aVaIlable dAta is toO sparSE for proPer parameTer infereNcEs. ThUS, We sHow further Evidence That the meMOryleSS mOdel sEemS to be a QuIte PractIcal anD LegItimaTe modeL fOr humaN naviGaTion on a pAge level.

-   By abstracting awAy from The paGe lEvel to a toPicAL leVel, the resUlts Are differeNt. BY rePreseNtiNG all dAtasETs As nAVigatIonaL Sequences OF tOpiCS ThAt describe uNDERlyIng WeB paGEs (cf. FiGure \[Fig:pathexample\]), we fINd evidence that TopiCAL naVigATion Of Humans is not memOryLeSS At all. On tHrEe rather difFerent daTaSEts of NavigaTion – frEe navigATIoN (mSNBC
 likelihood [@stigler2002s tatistics;  @ton g19 75] ,(ii)  Bay esian [@Streli o ff]and (iii) information- theor et i c me t ho ds [@ akaike; @k a t z;@m ur phy ;@ sc hwarz ; @ tong197 5]. We sup ple me nt these wit h  a  (iv) cros s v alidation ap pro ach fo ra p r edict ion  task  [@mur p hy]. W e thoroug hl y  elabo r ate eac h me thod , put them into r e la t ion to each ot her an da ls o hig hli ght streng th s and weaknes s es o f  ea c h. Such detai led derivat i onof mod el  pa r ameter s and  t h e m odel compar ison  is, forexampl e , missi n g in pr evious  wo rk[@ch i er ic het ti ] , w h ic h p r eve nts us f ro mdrawi ng d e f i n itecon clus ions.  We apply the semeth o dsto ou r hum an n av igati onal d ata i norder to get an  exh austive p ict ur e a bo ut me m ory in  hu man  naviga tion. F i nal ly , w eidentify structura la s pe cts by a nalyzi n gtr a nsitionma tri cesp r oduce d by ou r Markov  chain an al yses. ] {} ]{}

[ ** Con tri butio n s.** ]{} Th e main c ontri b utions of this work are thre e -f o l d: 
-  Fi rst, we dep loyf ourdiff e re nt, yet c omple me n ta r y, approaches for o rd er sel ectio n of Markov c hain model s ( likeliho od,B ay e sian, informat ion-t heoretic a n d crossvalid ation me thods) an d elaborat e t hei r s tre n g th s and weaknes s e s. [ [H ence, o urwork ex ten dsexi sti ng  studiesthat mod el  h um an  na vigat i on on th eWeb  u sin g Mar k ov cha in mo dels  [ @c h ier ichetti ] .] { } ]{}By  a pply ing  t hesemeth o dson navi gationalWeb data ,ou r workpresents – to  t he best of  o urknowle d g e – themost comprehensive ands ystemat icevalu atio n of Mark ovmodelord e rs for  human  navi ga tio n a l seq u e nc eson  the Web t o dat e. Fu rt herm ore, we  make our methodsi n t he form of an  op en s o u rc e f r am e wor ka vai l a ble online[^2]to aid fut ur e  w ork [@gith u b]. 
-   Our  empiri cal r e sults c onfirm wh at we inf er redf r omtheory: It  is diff icult tom ake p l au sible  st atemen ts  ab out t he app r opr iateMarkov  c hain o rderha ving ins ufficient data but a va st amo unt o f s tates, wh ich isa commonsitu ation forWeb  pa ge na vig a tiona l pa t hs . A l l eva luat i on approa c he s w o u ld  favor a ze r o orfirst  or d er bec ause  the number of pa r ameters growsexpo n e nti all y  wit hthe chain orde r a nd t he avail ab le data istoo spar se for p roperparame ter inf e r en c es. Th us,weshow furt her  e v idenceth at the me mory le ss mod el see m s to b e a quite practi cal a n d  legi t ima te mo de l for h u mannavigation  on a pagelevel. 

-  Byabstrac ti ng awa y f ro m the page level toa top ical le ve l, t heresult s ar e diffe rent .Byrepresent i n ga ll  d a tas etsas na vi gati onal sequ e nces oftop i cs that  d esc r i be und e rl y i ng Web pag es(cf.F i gure \[fig : path e xa m ple\] ), wefind e vidence tha ttopical  na v i gation of  humans i s  no tmemo ryless a tall.  O n t hr ee rather diffe rent dat asets of n avigat ion – fr e e navi ga tion (MSNBC
 likelihood_[@stigler2002statistics; @tong1975],_(ii) Bayesian [@Strelioff] and_(iii) information-theoretic_methods_[@akaike; @katz;_@murphy;_@schwarz; @tong1975]. We_supplement these with_a (iv) cross validation_approach for a_prediction_task [@murphy]. We thoroughly elaborate each method, put them into relation to each other_and_also highlight_strengths_and_weaknesses of each. Such detailed_derivation of model parameters and_the model_comparison is, for example, missing in previous work_[@chierichetti],_which prevents us_from drawing definite conclusions. We apply these methods to_our human navigational data in order_to get an_exhaustive_picture_about memory in human_navigation. Finally, we identify structural aspects_by analyzing transition matrices produced by_our Markov chain analyses. ]{}]{}

[**Contributions.**]{} The main_contributions of this work are three-fold:

-_  First, we deploy_four different,_yet complementary, approaches for order_selection of Markov_chain models_(likelihood, Bayesian, information-theoretic_and cross validation methods) and elaborate_their strengths and_weaknesses. [[Hence, our work extends existing_studies_that model human_navigation_on_the Web_using Markov chain_models_[@chierichetti].]{}]{} By_applying_these methods on navigational Web data,_our_work presents – to the best of_our knowledge – the_most_comprehensive and systematic evaluation_of Markov model orders for_human navigational sequences on the Web_to date._Furthermore, we_make our methods in the form of an open source framework_available online[^2] to aid future work_[@github].

-   Our_empirical results_confirm_what we inferred_from_theory: It_is difficult to make plausible statements about_the appropriate_Markov chain order having insufficient data_but a vast amount_of_states, which is a common situation_for Web page navigational paths. All_evaluation approaches would favor a_zero_or_first order because the number_of parameters grows exponentially with the_chain order and_the available data is too sparse for_proper_parameter inferences. Thus, we show further_evidence_that the memoryless model seems to_be_a_quite practical and legitimate model_for human navigation on a page_level.

-   By abstracting away from the page_level to a_topical level, the results are_different._By_representing all datasets as navigational sequences of topics that describe_underlying Web_pages (cf. Figure_\[fig:pathexample\]), we find evidence that topical navigation of humans is_not memoryless at all. On three rather_different datasets of navigation – free navigation (MSNBC