 accurate forecasting on large highway networks a challenging task. Recently, diffusion convolutional recurrent neural networks (DCRNNs) have achieved state-of-the-art results in traffic forecasting by capturing the spatiotemporal dynamics of the traffic. Despite the promising results, adopting DCRNN for large highway networks still remains elusive because of computational and memory bottlenecks. We present an approach to apply DCRNN for a large highway network. We use a graph-partitioning approach to decompose a large highway network into smaller networks and train them simultaneously on a cluster with graphics processing units (GPU). For the first time, we forecast the traffic of the entire California highway network with 11,160 traffic sensor locations simultaneously. We show that our approach can be trained within 3 hours of wall-clock time using 64 GPUs to forecast speed with high accuracy. Further improvements in the accuracy are attained by including overlapping sensor locations from nearby partitions and finding high-performing hyperparameter configurations for the DCRNN using DeepHyper, a hyperparameter tuning package. We demonstrate that a single DCRNN model can be used to train and forecast the speed and flow simultaneously and the results preserve fundamental traffic flow dynamics. We expect our approach for modeling a large highway network in short wall-clock time as a potential core capability in advanced highway traffic monitoring systems, where forecasts can be used to adjust traffic management strategies proactively given anticipated future conditions.

Introduction
============

In the United States alone, the estimated loss in economic value due to traffic congestion reaches into the tens or hundreds of billions of dollars, impacting not only the productivity lost due to additional travel time but also the additional inefficiencies and energy required for vehicle operation. To address these issues, Intelligent Transportation Systems (ITS) [@bishop2005intelligent] seek to better manage and mitigate congestion and other traffic-related issues via a range of data-informed strategies and highway traffic monitoring systems. Near-term traffic forecasting is a foundational component of these strategies; and accurate forecasting across a range of normal, elevated, and extreme levels of congestion is critical for improved traffic control, routing optimization, probability of incident prediction, and identification of other approaches for handling emerging patterns of congestion [@teklu2007genetic; @tang2005traffic]. Furthermore, these predictions and the related machine learning configurations and weights associated with a highly accurate model can be used to delve more deeply into the dynamics of a particular transportation network in order to identify additional areas of improvement above and beyond
accurate forecasting on large highway networks a challenging undertaking. Recently, dissemination convolutional recurrent neural networks (DCRNNs) have achieved country - of - the - art results in dealings forecasting by capturing the spatiotemporal dynamics of the dealings. Despite the bright results, adopting DCRNN for big highway networks still remains baffling because of computational and memory bottlenecks. We present an overture to apply DCRNN for a large highway net. We use a graph - partitioning approach to disintegrate a large highway network into smaller networks and train them simultaneously on a bunch with graphics processing unit (GPU). For the first time, we forecast the dealings of the entire California highway network with 11,160 traffic sensor locations simultaneously. We show that our overture can be trained within 3 hours of wall - clock time using 64 GPUs to forecast speed with high accuracy. Further improvements in the accuracy are attained by include overlapping sensor location from nearby partition and finding high - performing hyperparameter configurations for the DCRNN use DeepHyper, a hyperparameter tuning software. We demonstrate that a single DCRNN model can be use to train and forecast the speed and flow simultaneously and the results conserve fundamental traffic flow dynamics. We ask our approach for model a large highway network in short wall - clock time as a likely core capability in advanced highway traffic monitoring systems, where forecasts can be used to adjust traffic management strategies proactively give anticipated future condition. 

 Introduction 
 = = = = = = = = = = = = 

 In the United States alone, the estimated personnel casualty in economic value due to traffic congestion strive into the tens or hundred of billions of dollars, impacting not only the productivity lose due to additional travel time but also the additional inefficiencies and energy required for fomite operation. To address these issue, Intelligent Transportation Systems (ITS) [ @bishop2005intelligent ] seek to better manage and mitigate congestion and other traffic - related offspring via a range of data - informed strategies and highway traffic monitoring systems. cheeseparing - condition dealings prediction is a foundational component of these strategies; and accurate prediction across a range of normal, elevated, and extreme levels of congestion is critical for improved dealings control, routing optimization, probability of incident prediction, and identification of early approaches for handle emerging patterns of congestion [ @teklu2007genetic; @tang2005traffic ]. Furthermore, these prediction and the related machine learning shape and weights associated with a highly accurate exemplar can be used to delve more deeply into the dynamics of a particular transportation net in club to identify additional areas of improvement above and beyond
 acfurate forecasting on lavge highway networks a rhallenfing tasy. Recently, diffusion convoluvionql rexurrent neural networkr (DCRNNs) jave achuevev state-of-the-art cssults lu trarnic fmcecasting by cakturing the vpatiotemporal dhncmics of the traffic. Despite the proiising tedults, adopting DCRMG fod large highway networks still remzins ellsive because of vomputational and memory blttlfnecks. We present wn approach to wpply DCRNN fur a large highway netsork. We use a graph-partitioning apprpach to dexonpodg a large hijhway getwork into smaller networls and train tmem smmulraneously on a clustec with graphics procgssing unids (GPU). For the firsr rime, fe fmrecxwt ghe tcafric of thx entire Camifornia hithway network with 11,160 twqffic sensor mocatijnf simultaneously. We show that our approdch can be trained within 3 hours of wall-clock tlme using 64 GPUs to forecast speed with high accuracy. Furthar im'ruvenekts kb hhe accuracy are attained by including overla[limg sensor locatijns from nesrhy kartitions and findiuf gigh-performing hypfrparamgter cinfiguratyons for the DCRNN using DeepHyper, a hyperpcraneter tuning packaye. We demonscrate jhat a single DCRNN model can be hsed to traln and foddcast the speed xnd fnow simultaneously and the results 'resexve fundxmenjal trasfic flow fynamlws. We expect our aoproaeh fos modeling a large highway network in shocv wall-clock toma av a poteutial gore capability in advanced hnghway txaffic monitorinf systeks, where fowecasts can ba used to adjnst traffyc mqnagwment sgfategies proacyively gineu anticipqted future conditlons.

Ivfroduction
============

In thz Obited States akond, tre extykated loss it ecunoooc vauue due to brawfic congestion reaches hnto the tens or hundrrdf of biloions of dollars, impavting not only the prodnctivivy losy doe to additional travel time buf also thf aqditional inqffigiensies and euergy required for vehicle operation. To eddress these issues, Inrelligent Transportctlon Systems (MTS) [@bifhop2005intelnigent] seek to bettee manage and mitinate congestion and otger trdffic-gelated issues via a range of data-informed strategies and highway traffic monitoring systema. Nesr-terk crayfic fowecadving is a foundatponal component of these strategmes; and acwuxate forecasting across a ranbe of normal, elgvated, and extreme levels kf congextion is critical for improved yraffic control, routing pptimizarion, lrobabpmivy of incident predivtion, cnd idwntificqtiok of other appfoavhcs for hanflinj ejerging patterns of congestion [@twklu2007gebehic; @tang2005traffic]. Hurthermore, bhtse presictiogs and the relatsd mzfhine learning congigurations anc weights associated wyth a highly axburate model van bg used to delve more deeplf into the dynamics of a particular transportation hetwork ih order bo identify additolnal areas of improvemcnt afove and beyond
accurate forecasting on large highway networks a Recently, convolutional recurrent networks (DCRNNs) have forecasting capturing the spatiotemporal of the traffic. the promising results, adopting DCRNN for highway networks still remains elusive because of computational and memory bottlenecks. We present approach to apply DCRNN for a large highway network. We use a graph-partitioning to a highway into smaller networks and train them simultaneously on a cluster with graphics processing units (GPU). For first time, we forecast the traffic of the California highway network with traffic sensor locations simultaneously. We that approach can trained 3 of wall-clock time 64 GPUs to forecast speed with high accuracy. Further improvements in the accuracy are attained by including sensor locations partitions and high-performing configurations the DCRNN using hyperparameter tuning package. We demonstrate that model can be used to train and forecast speed and simultaneously and the results preserve fundamental flow dynamics. We expect our approach for modeling large highway network in short wall-clock time as a potential core capability in advanced highway systems, where forecasts can used to adjust management proactively anticipated conditions. Introduction In the United States alone, the estimated loss in economic value to traffic congestion reaches into the tens or hundreds of dollars, not only the lost due to additional time also the additional inefficiencies required vehicle these Intelligent Systems (ITS) [@bishop2005intelligent] seek better manage and mitigate congestion other traffic-related issues via and highway traffic monitoring systems. Near-term traffic forecasting a foundational component of these strategies; and forecasting across a range of normal, elevated, and extreme levels of congestion critical for control, routing optimization, probability of incident prediction, and of other approaches for emerging patterns of congestion [@teklu2007genetic; @tang2005traffic]. Furthermore, these predictions the machine learning and weights associated a highly accurate can be used more deeply the of network in order to identify additional of above and beyond
 accurate forecasting on largE highway neTworkS a cHalLeNginG tasK. Recently, diffuSIon cOnvolutional recurrent nEural NeTWorkS (dCrNNs) hAve achiEVeD STatE-oF-tHe-aRt REsUlts iN trAffic foRecasting bY caPtUring the spatIOtEmporal dynAmiCs of the traffIc. DEspite ThE prOMisinG reSults, AdoptiNG DCRNN For large hIgHWay netWOrks stiLL ReMainS elusive because of COmPUtational and meMory boTtLEnECKs. WE prEsent an appRoAch to APply DCRnn fOR A LarGE highway netwoRk. We use a graPH-paRtitioNiNg aPProach To decOmPOse A large highwAy neTwork into SmalleR NetworkS And traiN them sImuLtaNeouSLy On A clUsTEr wITh GraPHicS processInG uNits (GpU). FoR THE FirsT tiMe, we ForecAst the traffic Of tHe enTIre califOrnia HighWaY netwOrk witH 11,160 trafFiC sensor locationS simUltaneousLy. WE sHow ThAt our APproacH caN be Trained Within 3 hOUrs Of WALL-cLock time using 64 GPUs tO fOREcAst speed With hiGH aCcURacy. FurtHeR imProvEMEnts iN the ACcUracy are AttainED bY iNcludinG oVerlapPiNg sEnsOr locATionS from nEarby parTitioNS and finding higH-Performing hypERpARAmETer cOnfIgurations fOr thE dCRNn usiNG DEephYper, a HyperPaRAmETer tuning package. We dEmOnstraTe thaT a single DCRNN Model can be USED to train And fOReCAst the speed and Flow sImultaneouSLy and the ResulTs preserVe fundameNTAl traffiC flOw dYnaMicS. wE eXpect our approACH for MoDeling a LarGe highwAy nEtwOrk In sHoRt wall-cloCk time as A pOtEnTiAl cOre caPAbility iN aDvaNcEd hIghwaY TraffiC moniToriNg SySTemS, where fOReCASts cAn Be Used To aDjUst trAffiC ManAgement StrategieS prOActiVeLy Given anTicipated futuRe Conditions.

inTroDuctioN
============

iN the UnitEd States alone, the estimatED loss in EcoNomic ValuE due to traFfiC congeStiON reachEs into The teNs Or hUNDreds OF BiLliOnS of dollars, IMPacTing nOt Only The prodUctivity lost due to aDDitIonal travel tiMe bUt alSO ThE adDItIOnaL iNEffICIencies and energY required fOr VEhIcle operatIOn. TO aDdress tHese issUes, InTElligenT TransporTation SysTeMs (ITs) [@BIshOp2005intelligEnt] seek tO better maNAge anD MiTigatE coNgestiOn And Other TraffiC-RelAted iSsues vIa A range Of datA-iNformed sTrategies and highway trafFic monItoriNg sYstems. NeaR-teRM trAffic foreCastIng is a founDatIonAl comPonENt of tHese STrAteGIes; anD accURate forecAStIng ACRoSs a range of nORMAl, eLevatEd, aND extreMe leVels of congestion iS Critical for impRoveD TRafFic COntrOl, Routing optimizAtiOn, PRObabilitY oF incident prEdiction, AnD IdentIficatIon of oTher appROAcHEs for hAndlIng Emerging pAttErNS of congEsTiON [@teklu2007GeneTiC; @tang2005tRaffic]. fUrthERMore, these predictIons aND The reLAteD machInE learniNG conFigurationS and weights AssociAted With a Highly aCcUrate mOdeL cAn be used to DElve more dEeply Into the DyNamiCs oF a partIculAR TransPortAtIon Network in ORDeR To IdENtiFy adDitioNaL areAs of improVEment aboVe aND beyond
 accurate forecasting on l arge highw ay ne two rks  a  cha llen ging task. Rec e ntly , diffusion convolutio nal r ec u rren t  n eural  networ k s( D CRN Ns )hav ea ch ieved  st ate-of- the-art re sul ts  in trafficf or ecasting b y c apturing the  sp atiote mp ora l  dyna mic s ofthe tr a ffic.Despite t he promis i ng resu l t s,  ado pting DCRNN for l a rg e  highway netwo rks st il l  r e m ain s e lusive bec au se of computa t io n a l  an d  memory bottl enecks. Wep res ent an  a ppr o ach to  appl yD CRN N for a lar ge h ighway ne twork. We usea  graph- partit ion ing  app r oa ch  to  d e com p os e a lar ge highw ay  n etwor k in t o s mall ernetw orksand train the m s imul t ane ously  on a  clu st er wi th gra phics  p rocessing units  (GP U). For t hefi rst  t ime,w e fore cas t t he traf fic oft heen t i r eCalifornia highway  n e t wo rk with11,160 tr af f ic senso rloc atio n s  simu ltan e ou sly. Weshow t h at  o ur appr oa ch can  b e t rai ned w i thin  3 hou rs of wa ll-cl o ck time using6 4 GPUs to for e ca s t  s p eedwit h high accu racy .  Fur ther im pro v ement s inth e  a c curacy are attained  b y incl uding  overlappingsensor loc a t i ons from  nea r by partitions and  find ing high-p e rforming  hype rparamet er config u r ations f orthe  DC RNN u si ng DeepHyper, a  hyp er paramet ertuningpac kag e.Wede monstrate  that asi ng le  D CRN N mod e l can be  u sed  t o t raina nd for ecast  the  s pe e d a nd flow si m u ltan eo us ly a ndth e res ults pre serve f undamenta l t r affi cfl ow dyna mics. We expe ct  our appro ac h f or mod e l ing a la rge highway network ins hort wa ll- clock  tim e as a po ten tial c ore capabi lity i n adv an ced h ighwa y tr aff ic  monitorin g sys tems,  w here  foreca sts can be used to adj ust traffic m ana geme n t  s tra t eg i espr o act i v ely given antic ipated fut ur e  c onditions. 
In tr oductio n
===== ===== = =

In t he United  States a lo ne,t h e e stimated l oss in e conomic v a lue d u eto tr aff ic con ge sti on re achesi nto  thetens o rhundre ds of  b illionsof dollars, impacting n ot onl y the  pr oductivit y l o stdue to ad diti onal trave l t ime  butals o  theaddi t io nal ineff icie n cies ande ne rgy r eq uired for v e h i cle  oper ati o n. Toaddr ess these issues, Intelligent Tr ansp o r tat ion Syst em s (ITS) [@bish op2 00 5 i ntellige nt ] seek to b etter ma na g e and  mitig ate co ngestio n an d  other  tra ffi c-related  is su e s via a  r an g e of d ata- in formed  strat e gies a nd highway traff ic mo n i torin g  sy stems .Near-te r m tr affic fore casting isa foun dati onalcompone nt  of th ese  s trategies; and accur ate f orecast in g ac ros s a ra ngeo f  norm al,el eva ted, ande x tr e me  l e vel s of  cong es tion  is criti c al for i mpr o ved tra ff icc o ntrol, ro u t ing optimi zat ion,p r obabilityo f in c id e nt pr edicti on, an d ident i fic at ion ofoth e r  approach es for ha n dli ng  eme rging pa tt erns  o f c on gestion [@teklu 2007gene tic; @ta n g 2005tr aff i c].F urther mo re, these pr edict io n s and t h e  re lated m a chi nelea rnin g c onfi g urations and weights ass ocia ted w i tha hig hly a cc urate mo d el c an be us e d to delve mo re deeply intot hed ynam ics of  a  particul art ransp orta tio n ne two rk i n orde r  toi de ntif y addi tion al  a reas of i mp rovemen t  abo v e a nd b eyond 
 accurate_forecasting on_large highway networks a_challenging task._Recently,_diffusion convolutional_recurrent_neural networks (DCRNNs)_have achieved state-of-the-art_results in traffic forecasting_by capturing the_spatiotemporal_dynamics of the traffic. Despite the promising results, adopting DCRNN for large highway networks_still_remains elusive_because_of_computational and memory bottlenecks. We_present an approach to apply_DCRNN for_a large highway network. We use a graph-partitioning_approach_to decompose a_large highway network into smaller networks and train them_simultaneously on a cluster with graphics_processing units (GPU)._For_the_first time, we forecast_the traffic of the entire California_highway network with 11,160 traffic sensor_locations simultaneously. We show that our approach_can be trained within 3 hours_of wall-clock time using 64_GPUs to_forecast speed with high accuracy._Further improvements in_the accuracy_are attained by_including overlapping sensor locations from nearby_partitions and finding_high-performing hyperparameter configurations for the DCRNN_using_DeepHyper, a hyperparameter_tuning_package._We demonstrate_that a single_DCRNN_model can_be_used to train and forecast the_speed_and flow simultaneously and the results preserve_fundamental traffic flow dynamics._We_expect our approach for_modeling a large highway network_in short wall-clock time as a_potential core_capability in_advanced highway traffic monitoring systems, where forecasts can be used to_adjust traffic management strategies proactively given_anticipated future conditions.

Introduction
============

In the_United States_alone,_the estimated loss_in_economic value_due to traffic congestion reaches into the_tens or_hundreds of billions of dollars, impacting_not only the productivity_lost_due to additional travel time but_also the additional inefficiencies and energy_required for vehicle operation. To_address_these_issues, Intelligent Transportation Systems (ITS)_[@bishop2005intelligent] seek to better manage and_mitigate congestion and_other traffic-related issues via a range of_data-informed_strategies and highway traffic monitoring systems._Near-term_traffic forecasting is a foundational component_of_these_strategies; and accurate forecasting across_a range of normal, elevated, and_extreme levels of congestion is critical for improved traffic_control, routing optimization,_probability of incident prediction, and_identification_of_other approaches for handling emerging patterns of congestion [@teklu2007genetic; @tang2005traffic]._Furthermore, these_predictions and the_related machine learning configurations and weights associated with a highly_accurate model can be used to delve_more deeply into the dynamics of a particular transportation network in_order to identify additional areas of improvement above_and beyond