 discussed in the Proposed Approaches section, the two CNNs can be entirely separate, almost identical, or partially joint, leading to different performances in training as well as in application. We carry out extensive simulation studies, and show that the proposed neural model selector and parameter estimator can be properly trained, and the trained CNNs demonstrate excellent performance in test data and a real data application. The idea and proposed framework can be further extended to the entire SA process with the potential to change how SA is done in conventional data analysis and big data analytics.

Related work
============

There exists an extensive statistical literature on model selection [@bozdogan1987model; @burnham2003model; @burnham2004multimodel]. Numerous model selection methods have been proposed. Some of these methods are not applicable to the setting we consider in this paper, while others, though applicable, may run into various difficulties; see discussions in Section \[sec:proposedApproach\] for details. To our best knowledge, there is no prior work about redefining the model selection problem as a machine learning classification problem and training CNN to learn and perform model selection with labeled simulated data.

There also exist a variety of statistical methods for parameter estimation in the literature; see [@casella2002statistical; @huber1964robust; @norton2010identification]. Most statistical methods rely on full or partial knowledge of the model and are based on statistical principles. After conducting intensive literature search, we only found one paper [@xie2007estimation], in which the authors proposed to use artificial neural networks and simulated data to construct estimates for parameters of a stochastic differential equation. However, the idea of using CNNs and simulated data to automate parameter estimation and model selection and bring AI to the general SA process appears to be novel to our best knowledge.

Proposed approach {#sec:proposedApproach}
=================

As discussed in the Introduction, we first reformulate model building and parameter estimation as a machine learning problem. Suppose $\mathcal{M}=\{M_k: 1\le k \le K\}$ be a collection of $K$ prespecified models/distributions. Let $f(y|\theta_k, M_k)$ be the density function of model $M_k$, where $\theta_k\in \Theta_k$ is the scalar parameter of the density function. Assume that we have a random sample from one of the models, which is $\{y_j\}_{1\
discussed in the Proposed Approaches section, the two CNNs can be entirely separate, about identical, or partially joint, go to different performances in education as well as in lotion. We carry out extensive pretense study, and show that the proposed neural model picker and parameter estimator can be properly trained, and the coach CNNs demonstrate excellent performance in test data and a real datum application. The idea and proposed model can be further extended to the entire SA process with the potential to switch how SA is done in conventional data analysis and big datum analytics. 

 Related work 
 = = = = = = = = = = = = 

 There exists an extensive statistical literature on model selection [ @bozdogan1987model; @burnham2003model; @burnham2004multimodel ]. Numerous exemplar selection methods have been proposed. Some of these methods are not applicable to the setting we consider in this paper, while others, though applicable, may run into various difficulties; attend discussions in Section \[sec: proposedApproach\ ] for details. To our dear cognition, there is no prior work about redefining the model selection problem as a machine determine classification problem and training CNN to learn and perform mannequin selection with labeled simulated data. 

 There besides exist a variety of statistical method acting for argument estimate in the literature; see [ @casella2002statistical; @huber1964robust; @norton2010identification ]. Most statistical methods rely on wide or partial knowledge of the model and are free-base on statistical principles. After conducting intensive literature search, we only found one newspaper [ @xie2007estimation ], in which the authors aim to use artificial nervous networks and simulated data to construct estimate for parameters of a stochastic differential equality. However, the idea of using CNNs and simulated datum to automate parameter estimation and model selection and bring AI to the general SA process appears to be novel to our best knowledge. 

 Proposed access { # sec: proposedApproach } 
 = = = = = = = = = = = = = = = = = 

 As discussed in the Introduction, we foremost reformulate model building and parameter estimation as a machine learning trouble. Suppose $ \mathcal{M}=\{M_k: 1\le k \le K\}$ be a collection of $ K$ prespecified models / distributions. Let $ f(y|\theta_k, M_k)$ be the density affair of exemplar $ M_k$, where $ \theta_k\in \Theta_k$ is the scalar parameter of the density function. Assume that we have a random sample from one of the model, which is $ \{y_j\}_{1\
 didcussed in the Proposed Xpproaches sectnin, the two CHNs can ce entirely separate, almost mdenrical, or partially joint, lexding to fifferenr pecformances in trejning as well ws iu epplication. We garry out eftensive simuldtkou studies, and show that the proposed neural mldel selector wnd karwmetsg tstimator can be properly trained, and tht trained CNNs dempnstrate excellent performwnce in test data and w real data appjucation. The kdea and pgmposed frajework can be further extended go thz entire SA peocfvs with the potegtial to chakbe how SA is cone in convenbionan dqta analysis and big vata analytics.

Relateq work
============

These exists an extensuvw stajistiwal uutefathrx oh modep sxlection [@boadogan1987model; @burnham2003model; @burnhsm2004ilktimodel]. Numsrous ioqel selection methods have been proposeg. Skme of these methods arw not applicable to tje settind we consider in this paper, while others, though a[plicebue, nan ruv ijto various difficulties; see discussions in Sqdtook \[sec:proposedAppvoach\] for details. Yo oit best knowledee, thexs js no prior work ahout reqefinung the mjdel selection problem as a macyine learniny coassification probpem and tranning VNN tp learn and perform modzl selsction with labeled akmulated data.

Thefe slvo exist a variety of statystical mxthodx for pxramgter eseimation ij the literature; see [@casflla2002sjatisthcal; @huber1964gobust; @norton2010identification]. Mosv statistical mathmds rely on fmll or partial hnowledge of tke model and xre based kn statmstical prinsiples. After wlnducting invensive lyterqturw searcf, we only found one papeg [@rie2007estimarion], in which the euthuds proposed to brt qrtificial neutal neewlrls dnd simulateg daga gp conrtruct tftlmages gor parameters of a vtocgastic differentiak cquation. Yowever, ehe idea of uxing CNNs and simupated dava to sutjmate parameter estimation and model sepecbion and brind AI to the genexal SA process appears to be novel to ouc best knowledge.

Proposgd approach {#sec:proposgdAkproach}
=================

As disrussed in the Ittroduction, we first reformulate modek building and paramefer esdimatlon as a machine learning problem. Suppose $\mathcal{M}=\{M_k: 1\le k \le K\}$ be a collextion of $K$ prespecjfiec modvls/biscributijns. Pxt $f(y|\theta_k, M_k)$ be the density function of model $O_k$, where $\tketa_k\in \Theta_k$ is the scalar lafameter of thg density function. Assume fhat we nave a random sample from one og the models, which is $\{y_j\}_{1\
discussed in the Proposed Approaches section, the can entirely separate, identical, or partially in as well as application. We carry extensive simulation studies, and show that proposed neural model selector and parameter estimator can be properly trained, and the CNNs demonstrate excellent performance in test data and a real data application. The and framework be extended to the entire SA process with the potential to change how SA is done in data analysis and big data analytics. Related work There exists an extensive literature on model selection [@bozdogan1987model; @burnham2004multimodel]. model selection have proposed. of these methods not applicable to the setting we consider in this paper, while others, though applicable, may run into difficulties; see Section \[sec:proposedApproach\] details. our knowledge, there is work about redefining the model selection machine learning classification problem and training CNN to and perform selection with labeled simulated data. There exist a variety of statistical methods for parameter in the literature; see [@casella2002statistical; @huber1964robust; @norton2010identification]. Most statistical methods rely on full or partial the model and are on statistical principles. conducting literature we found one [@xie2007estimation], in which the authors proposed to use artificial neural networks simulated data to construct estimates for parameters of a stochastic However, idea of using and simulated data to parameter and model selection and to general to novel our best knowledge. Proposed {#sec:proposedApproach} ================= As discussed in Introduction, we first reformulate as a machine learning problem. Suppose $\mathcal{M}=\{M_k: 1\le \le K\}$ be a collection of $K$ models/distributions. Let $f(y|\theta_k, M_k)$ be the density function of model $M_k$, where \Theta_k$ is parameter of the density function. Assume that we a random sample from of the models, which is $\{y_j\}_{1\
 discussed in the Proposed AppRoaches secTion, tHe tWo CnNS can Be enTirely separate, ALmosT identical, or partially jOint, lEaDIng tO DiFfereNt perfoRMaNCEs iN tRaIniNg AS wEll as In aPplicatIon. We carry Out ExTensive simulATiOn studies, aNd sHow that the prOpoSed neuRaL moDEl selEctOr and ParameTEr estiMator can bE pROperly TRained, aND ThE traIned CNNs demonstraTE eXCellent performAnce in TeST dATA anD a rEal data appLiCatioN. the idea ANd PROPosED framework can Be further exTEndEd to thE eNtiRE SA proCess wItH The Potential to ChanGe how SA is Done in COnventiONal data AnalysIs aNd bIg daTA aNaLytIcS.

relATeD woRK
============

ThEre existS aN eXtensIve sTATISticAl lIterAture On model selectIon [@BozdOGan1987Model; @BurnhAm2003moDeL; @burnHam2004mulTimodEl]. numerous model seLectIon methodS haVe BeeN pRoposED. Some oF thEse Methods Are not aPPliCaBLE To The setting we considEr IN ThIs paper, wHile otHErS, tHOugh applIcAblE, may RUN into VariOUs DifficulTies; seE DiScUssions In sectioN \[sEc:pRopOsedAPProaCh\] for dEtails. To Our beST knowledge, therE Is no prior work ABoUT ReDEfinIng The model selEctiON proBlem AS a MacHIne leArninG cLAsSIfication problem and TrAining cNN to Learn and perfoRm model selECTIon with lAbelED sIMulated data.

TheRe alsO exist a varIEty of staTistiCal methoDs for paraMETer estimAtiOn iN thE liTERaTure; see [@casellA2002STatiStIcal; @hubEr1964rObust; @noRtoN2010idEntIfiCaTion]. Most sTatisticAl MeThOdS reLy on fULl or partIaL knOwLedGe of tHE model And arE basEd On STatIstical PRiNCIpleS. AFtEr coNduCtIng inTensIVe lIteratuRe search, wE onLY fouNd OnE paper [@xIe2007estimation], iN wHich the autHoRs pRoposeD TO use artiFicial neural networks and SImulateD daTa to cOnstRuct estimAteS for paRamETers of A stochAstic DiFfeRENtial EQUaTioN. HOwever, the iDEA of Using cNns anD simulaTed data to automate pARamEter estimatioN anD modEL SeLecTIoN And BrINg Ai TO the general SA prOcess appeaRs TO bE novel to ouR BesT kNowledgE.

ProposEd appROach {#sec:ProposedAPproach}
=================

As DiScusSED in The IntroduCtion, we fIrst reforMUlate MOdEl buiLdiNg and pArAmeTer esTimatiON as A machIne leaRnIng proBlem. SUpPose $\mathCal{M}=\{M_k: 1\le k \le K\}$ be a collectiOn of $K$ pRespeCifIed models/DisTRibUtions. Let $F(y|\thEta_k, M_k)$ be thE deNsiTy funCtiON of moDel $M_K$, WhEre $\THeta_k\In \ThETa_k$ is the sCAlAr pARAmEter of the deNSITy fUnctiOn. ASSume thAt we Have a random sample FRom one of the modEls, wHICh iS $\{y_j\}_{1\
 discussed in the Proposed  Approache s sec tio n,th e tw o CN Ns can be enti r elyseparate, almost ident ical,  o r  par t ia lly j oint, l e ad i n g t odi ffe re n tperfo rma nces in  trainingaswe ll as in app l ic ation. Wecar ry out exten siv e simu la tio n  stud ies , and  showt hat th e propose dn euralm odel se l e ct or a nd parameter esti m at o r can be prope rly tr ai n ed , and  th e trainedCN Ns de m onstrat e  e x c e lle n t performance  in test da t a a nd a r ea l d a ta app licat io n . T he idea and  pro posed fra mework can bef urtherextend edtothee nt ir e S Ap roc e ss  wi t h t he poten ti al  to c hang e h o w SA  is  don e inconventionaldat a an a lys is an d big  dat aanaly tics.
Rela te d work
======== ==== 

There e xis ts  an  e xtens i ve sta tis tic al lite ratureo n m od e l se lection [@bozdogan 19 8 7 mo del; @bu rnham2 0 03 mo d el; @bur nh am2 004m u l timod el]. Nu merous m odel s e le ct ion met ho ds hav ebee n p ropos e d. S ome of  these m ethod s  are not appli c able to the s e tt i n gw e co nsi der in this  pap e r, w hile ot her s , tho ugh a pp l ic a ble, may run into v ar ious d iffic ulties; see d iscussions i n  Section  \[s e c: p roposedApproac h\] f or details .  To ourbestknowledg e, therei s  no prio r w ork  ab out r ed efining the m o d el s el ectionpro blem as  amac hin e l ea rning cla ssificat io npr ob lem  andt rainingCN N t olea rn an d  perfo rm mo delse le c tio n withl ab e l ed s im ul ated  da ta .

Th erea lso  exista variety  of stat is ti cal met hods for para me ter estima ti onin the l iteratur e; see [@casella2002sta t istical ; @ huber 1964 robust; @ nor ton201 0id e ntific ation] . Mos tsta t i stica l me tho ds  rely on f u l l o r par ti al k nowledg e of the model and are  based on sta tis tica l pr inc i pl e s.Af t erc o nducting intens ive litera tu r esearch, we onl yfound o ne pape r [@x i e2007es timation] , in whic hthea u tho rs propose d to use  artifici a l neu r al  netw ork s andsi mul ateddata t o  co nstru ct est im ates f or pa ra meters o f a stochastic differen tial e quati on.  However,  th e  id ea of usi ng C NNs and si mul ate d dat a t o  auto mate pa ram e ter e stim a tion andm od els e le ction and b r i n g A I tothe genera l SA  process appearst o be novel toourb e stkno w ledg e. 

Proposed app roa ch { #sec:pro po sedApproach }
====== == = ===== ===

A s disc ussed i n th e  Intro duct ion , we firs t r ef o rmulate  m od e l buil ding  a nd par ameter esti m a tion as a machin e lea r n ing p r obl em. S up pose $\ m athc al{M}=\{M_ k: 1\le k \ le K\} $ be  a co llectio nof $K$  pr es pecified m o dels/dist ribut ions. L et  $f( y|\ theta_ k, M _ k )$ be  the  d ens ity funct i o no fmo d el$M_k $, wh er e $\ theta_k\i n  \Theta_ k$i s the s ca lar p aramet e ro f  the densi tyfunct i o n. Assumet hatw eh ave a  rando m samp le from one  o f the m ode l s , which i s $\{y_j\ } _{1 \
 discussed_in the_Proposed Approaches section, the_two CNNs_can_be entirely_separate,_almost identical, or_partially joint, leading_to different performances in_training as well_as_in application. We carry out extensive simulation studies, and show that the proposed neural_model_selector and_parameter_estimator_can be properly trained, and_the trained CNNs demonstrate excellent_performance in_test data and a real data application. The_idea_and proposed framework_can be further extended to the entire SA process_with the potential to change how_SA is done_in_conventional_data analysis and big_data analytics.

Related work
============

There exists an extensive_statistical literature on model selection [@bozdogan1987model;_@burnham2003model; @burnham2004multimodel]. Numerous model selection methods have_been proposed. Some of these methods_are not applicable to the_setting we_consider in this paper, while_others, though applicable,_may run_into various difficulties;_see discussions in Section \[sec:proposedApproach\] for_details. To our_best knowledge, there is no prior_work_about redefining the_model_selection_problem as_a machine learning_classification_problem and_training_CNN to learn and perform model_selection_with labeled simulated data.

There also exist a_variety of statistical methods_for_parameter estimation in the_literature; see [@casella2002statistical; @huber1964robust; @norton2010identification]._Most statistical methods rely on full_or partial_knowledge of_the model and are based on statistical principles. After conducting intensive_literature search, we only found one_paper [@xie2007estimation], in which_the authors_proposed_to use artificial_neural_networks and_simulated data to construct estimates for parameters_of a_stochastic differential equation. However, the idea_of using CNNs and_simulated_data to automate parameter estimation and_model selection and bring AI to_the general SA process appears_to_be_novel to our best knowledge.

Proposed_approach {#sec:proposedApproach}
=================

As discussed in the Introduction,_we first reformulate_model building and parameter estimation as a_machine_learning problem. Suppose $\mathcal{M}=\{M_k: 1\le k_\le_K\}$ be a collection of $K$_prespecified_models/distributions._Let $f(y|\theta_k, M_k)$ be the_density function of model $M_k$, where_$\theta_k\in \Theta_k$ is the scalar parameter of the density_function. Assume that_we have a random sample_from_one_of the models, which is $\{y_j\}_{1\