 of the transition matrix will result in a shape signature that is too dependent on noise and the individualness of specific waveform to be of any use. Thus additional processing is necessary for further analysis; even a small set of states (12 x 12) will result in a feature vector with high dimensionality (144 dimensions). While a window and overlap size is assumed for the slotting to address the irregular sampling of the time series data, there are two adjustable features associated with this analysis: the kernel width associated with the slotting and the state space (alphabet) resolution. It is apparent that a range of resolutions and kernel width need to be tested to determine best performance given a generic supervised classifier. For these purposes a rapid initial classification algorithm, General Quadratic Discriminate Analysis [@Duda2012], was implemented to estimate the mis-classification rate (wrong decisions/total decisions). Not all states will be observed, i.e. the high dimensional feature vector will have information contained in a small subset of elements. Dimensionality reduction methods are often necessary for implementation of classification algorithms, in particular QDA where the construction of a covariance matrix of a sparse feature space can be problematic.

The reduction of the large, sparse, feature vector resulting from the unpacking of the Markov Matrix is performed via extended canonical variate analysis or ECVA [@Norgaard2006]. The methodology for ECVA has roots in principle component analysis (PCA). PCA is a procedure performed on large multidimensional datasets with the intent of rotating what is a set of possibly correlated dimensions into a set of linearly uncorrelated variables [@Sch06]. The transformation results in a dataset, where the first principle component (dimension) has the largest possible variance. PCA is an unsupervised methodology, i.e. a priori known labels for the data being processed is not taken into consideration, thus a reduction in feature dimensionality and while it maximizes the variance it might not maximize the linear separability of the class space. In contrast to PCA, Canonical Variate Analysis does take class labels into considerations. The variation between groups is maximized resulting in a transformation that benefits the goal of separating classes. Given a set of data $\mathbf{x}$ with: $g$ different classes, $n_{i}$ observations of each class, and $r\times r$ dimensions in each observation; following @Johnson1992, the within-group and between-group covariance matrix is defined as:

$$\mathbf{S}_{within}=\frac{1}{n
of the transition matrix will result in a shape signature that is excessively pendent on noise and the individualness of specific waveform to be of any use. therefore additional processing is necessary for further analysis; even a small stage set of states (12 x 12) will result in a feature of speech vector with eminent dimensionality (144 dimensions). While a windowpane and overlap size is assumed for the slotting to address the irregular sample distribution of the time series datum, there are two adjustable feature associated with this analysis: the kernel width associated with the slotting and the state quad (alphabet) resolution. It is apparent that a range of resolution and kernel width need to be tested to determine best performance give a generic supervised classifier. For these purposes a rapid initial classification algorithm, General Quadratic Discriminate Analysis [ @Duda2012 ], was implemented to estimate the mis - classification pace (incorrect decisions / total decisions). Not all states will be observed, i.e. the high dimensional feature vector will have information incorporate in a small subset of elements. Dimensionality decrease method are much necessary for implementation of classification algorithm, in particular QDA where the structure of a covariance matrix of a sparse feature space can be problematic. 

 The decrease of the large, sparse, feature vector resulting from the unpacking of the Markov Matrix is performed via extended canonical random variable analysis or ECVA [ @Norgaard2006 ]. The methodology for ECVA has roots in principle component analysis (PCA). PCA is a procedure performed on bombastic multidimensional datasets with the intent of rotating what is a set of possibly correlated dimensions into a hardening of linearly uncorrelated variables [ @Sch06 ]. The transformation results in a dataset, where the first principle part (dimension) have the largest possible variability. PCA is an unsupervised methodology, i.e. a priori known label for the data being processed is not learn into consideration, therefore a reduction in feature dimensionality and while it maximizes the variance it might not maximize the analogue separability of the class space. In contrast to PCA, Canonical Variate Analysis does assume class label into considerations. The variation between groups is maximized resulting in a transformation that benefits the goal of separating classes. yield a set of datum $ \mathbf{x}$ with: $ g$ different classes, $ n_{i}$ observations of each course, and $ r\times r$ dimensions in each observation; following @Johnson1992, the within - group and between - group covariance matrix is defined as: 

 $ $ \mathbf{S}_{within}=\frac{1}{n
 of the transition matrix wlll result in a shape smgnaturs that ir too dependent on noise and tye ineividualness of specifkc wavefogm to be if aiy use. Thus addivjonal pvjcesalng iv necessary for further atalysis; even a soapl set of states (12 x 12) will result in a featirf vector with righ qimehsionality (144 dimensions). While a winsow and overlap size is assumed for the slottijg tl address the irrehular samplung jd the time sdries data, there are tso adjustable features associatdd wich this anaoywis: jhe kernel wmdth afsociated wibn the vlottinb and the statc spare (aophabet) resolution. It is apparent that w range ox xesolutions and kerneo qidth neeg to ve gesued tk detegmiie best perrormance gicen a generic superfifvc classifier. For trefe purposes a rapid initial classificatpon zlgorithm, General Quadrqtic Discriminate Anapysis [@Dudw2012], was implemented to estimate the mis-classificatimn rave (wrinn dezuslons/total decisions). Not all states will be obfsrfec, i.e. the high bimensional featirf fgctor will havg informatjon contained in a small fubser of elemtnts. Cimensionality reduction merhods are ofnen becessary for implzmentation oy clasxificstion algorithms, in parciculad QDA where the consffuction of a covxrisnwe matrix of a sparse feattre space can be proclemstic.

Thq reductioj of bve large, sparse, fewture vactor resupting from the unpacking of the Markov Matrix iv pvrformed ria exbended canonicaj variate analisis or EEVA [@Nofgaard2006]. The methodmlogy for ESVA has roots ln principle componegt abalywis (PCA). OCA is a procecure performed on lqrge multidimensiokal dxfasets with the inuebt of rotating whxt ys a sqd of possiblf cofreusted aimensions lntu a xet of linearly uncosrelzted variables [@Sch06]. Tme transfirmation results in a dataset, where the firsv prinriple vomkonent (dimension) has the largesf possiblf vwriance. PCA ys ak unfupervised methodology, i.e. a priori known labels fir the data being processed is not taltn into consiveratijn, thus a reduction in featurw dimensionality snd while it maximizea the eariajce it might not maximize the linear separability of the class space. In cintrasv eo PCA, Canohicak Varpatz Aualysis doed take class labeks into considerations. The varietion betwaeu groups is maximized resultimg in a transfotmation that benefits the foal of xeparating classes. Given a set pf data $\mathbf{x}$ with: $g$ dlfferent xlassss, $n_{i}$ obsecvations of each claxs, and $r\timws r$ dinenslons in each ocsetvwtion; folpowiig @Lohnson1992, the within-group and betwewn-group fovariance matrie is defined xs:

$$\matgbf{S}_{wijhin}=\frac{1}{n
of the transition matrix will result in signature is too on noise and to of any use. additional processing is for further analysis; even a small of states (12 x 12) will result in a feature vector with high (144 dimensions). While a window and overlap size is assumed for the slotting address irregular of time series data, there are two adjustable features associated with this analysis: the kernel width associated the slotting and the state space (alphabet) resolution. is apparent that a of resolutions and kernel width to tested to best given generic supervised classifier. these purposes a rapid initial classification algorithm, General Quadratic Discriminate Analysis [@Duda2012], was implemented to estimate the rate (wrong Not all will observed, the high dimensional will have information contained in a elements. Dimensionality reduction methods are often necessary for of classification in particular QDA where the construction a covariance matrix of a sparse feature space be problematic. The reduction of the large, sparse, feature vector resulting from the unpacking of Matrix is performed via canonical variate analysis ECVA The for has roots principle component analysis (PCA). PCA is a procedure performed on large datasets with the intent of rotating what is a set correlated into a set linearly uncorrelated variables [@Sch06]. transformation in a dataset, where principle (dimension) possible PCA an unsupervised methodology, i.e. priori known labels for the being processed is not reduction in feature dimensionality and while it maximizes variance it might not maximize the linear of the class space. In contrast to PCA, Canonical Variate Analysis does class labels The variation between groups is maximized resulting in transformation that benefits the of separating classes. Given a set of data $\mathbf{x}$ $g$ classes, $n_{i}$ of each class, $r\times r$ dimensions each observation; following within-group and covariance is
 of the transition matrix will Result in a sHape sIgnAtuRe That Is toO dependent on noISe anD the individualness of spEcifiC wAVefoRM tO be of Any use. THUs ADDitIoNaL prOcESsIng is NecEssary fOr further aNalYsIs; even a small SEt Of states (12 x 12) wIll Result in a feaTurE vectoR wIth HIgh diMenSionaLity (144 diMEnsionS). While a wiNdOW and ovERlap sizE IS aSsumEd for the slotting tO AdDRess the irregulAr sampLiNG oF THe tIme Series data, ThEre arE Two adjuSTaBLE FeaTUres associateD with this anALysIs: the kErNel WIdth asSociaTeD WitH the slottinG and The state sPace (alPHabet) reSOlution. it is apParEnt That A RaNgE of ReSOluTIoNs aND keRnel widtH nEeD to be TestED TO DeteRmiNe beSt perFormance given A geNeriC SupErvisEd claSsifIeR. For tHese puRposeS a Rapid initial claSsifIcation alGorItHm, GEnEral QUAdratiC DiScrIminate analysiS [@dudA2012], wAS IMpLemented to estimate ThE MIs-ClassifiCation RAtE (wROng decisIoNs/tOtal DECisioNs). NoT AlL states wIll be oBSeRvEd, i.e. the HiGh dimeNsIonAl fEaturE VectOr will Have infoRmatiON contained in a sMAll subset of elEMeNTS. DIMensIonAlity reductIon mEThodS are OFtEn nECessaRy for ImPLeMEntation of classificAtIon algOrithMs, in particulaR QDA where tHE COnstructIon oF A cOVariance matrix Of a spArse featurE Space can Be proBlematic.

the reductION of the laRge, SpaRse, FeaTURe Vector resultiNG From ThE unpackIng Of the MaRkoV MaTriX is PeRformed viA extendeD cAnOnIcAl vAriatE Analysis Or eCVa [@NOrgAard2006]. THE methoDologY for eCvA HAs rOots in pRInCIPle cOmPoNent AnaLySis (PCa). PCA IS a pRocedurE performeD on LArge MuLtIdimensIonal datasets WiTh the intenT oF roTating WHAt is a set Of possibly correlated dimENsions iNto A set oF linEarly uncoRreLated vAriABles [@ScH06]. The trAnsfoRmAtiON ResulTS In A daTaSet, where thE FIrsT prinCiPle cOmponenT (dimension) has the laRGesT possible variAncE. PCA IS An UnsUPeRVisEd MEthODOlogy, i.e. a priori kNown labels FoR ThE data being PRocEsSed is noT taken iNto coNSideratIon, thus a rEduction iN fEatuRE DimEnsionalitY and whilE it maximiZEs the VArIance It mIght noT mAxiMize tHe lineAR seParabIlity oF tHe clasS spacE. IN contrasT to PCA, Canonical Variate ANalysiS does TakE class labEls INto ConsideraTionS. The variatIon BetWeen gRouPS is maXimiZEd ResULting In a tRAnsformatIOn ThaT BEnEfits the goaL OF SepAratiNg cLAsses. GIven A set of data $\mathbf{x}$ WIth: $g$ different cLassES, $N_{i}$ oBseRVatiOnS of each class, anD $r\tImES R$ dimensiOnS in each obseRvation; fOlLOwing @johnsoN1992, the wiThin-groUP AnD BetweeN-groUp cOvariance MatRiX Is definEd As:

$$\MAthbf{S}_{WithIn}=\Frac{1}{n
 of the transition matrixwill resul t ina s hap esign atur e that is tood epen dent on noise and theindiv id u alne s sof sp ecificw av e f orm  t obeof an y use . T hus add itional pr oce ss ing is neces s ar y for furt her  analysis; e ven  a sma ll  se t  of s tat es (1 2 x 12 )  willresult in  a featur e  vector w it h hi gh dimensionality (1 4 4 dimensions).  While  a wi n d owand  overlap s iz e isa ssumedf or t h e s l otting to add ress the ir r egu lar sa mp lin g  of th e tim es eri es data, th ereare two a djusta b le feat u res ass ociate d w ith  thi s  a na lys is :  th e  k ern e l w idth ass oc ia ted w itht h e slot tin g an d the  state space(al phab e t)resol ution . It  i s app arentthatarange of resolu tion s and ker nel  w idt hneedt o be t est edto dete rmine b e stpe r f o rm ance given a gener ic s up ervisedclassi f ie r. For thes epur pose s a rap id i n it ial clas sifica t io nalgorit hm , Gene ra l Q uad ratic Disc rimina te Analy sis [ @ Duda2012], was implemented t o  e s t im a te t hemis-classif icat i on r ate( wr ong decis ions/ to t al decisions). Not all  s tateswillbe observed,i.e. the h i g h  dimensi onal fe a ture vector wi ll ha ve informa t ion cont ained  in a sm all subse t of eleme nts . D ime nsi o n al ity reduction m etho ds  are of ten  necess ary  fo r i mpl em entationof class if ic at io n a lgori t hms, inpa rti cu lar  QDAw here t he co nstr uc ti o n o f a cov a ri a n ce m at ri x of  asp arsefeat u respace c an be pro ble m atic .
T he redu ction of thela rge, spars e,  fe aturev e ctor res ulting from the unpacki n g of th e M arkov  Mat rix is pe rfo rmed v iae xtende d cano nical  v ari a t e ana l y si s o rECVA [@Nor g a ard 2006] .Themethodo logy for ECVA hasr oot s in principl e c ompo n e nt  an a ly s is(P C A). P CA is a procedu re perform ed on  large mul t idi me nsional  datase ts wi t h the i ntent ofrotatingwh at i s a s et of poss ibly cor related d i mensi o ns  into  aset of  l ine arlyuncorr e lat ed va riable s[@Sch0 6]. T he  transfo rmation results in a da taset,  wher e t he firstpri n cip le compon ent(dimension ) h asthe l arg e st po ssib l evar i ance.  PCA is an uns u pe rvi s e dmethodology , i .e.  a pr ior i  known  lab els for the datab eing processed  isn o t t ake n  int oconsideration,  th us a  reducti on  in feature  dimensi on a lityand wh ile it  maximi z e st he var ianc e i t might n otma x imize t he  l i near s epar ab ilityof the clas s space. In contra st to P CA, C a non icalVa riate A n alys is does ta ke class la bels i ntoconsi deratio ns . Thevar ia tion betwe e n groupsis ma ximized  r esul tin g in a  tra n s forma tion  t hat  benefits t he go al ofsepa ratin gclas ses. Give n  a set o f d a ta $\ma th bf{ x } $ with :  $ g $  different  cl asses , $n_{i}$ ob s erva t io n s ofeach c lass,and $r\ t ime sr$ dime nsi o n s in each  observat i on;  f ollo wing @Jo hn son1 99 2,th e within-groupand betw een-grou p covari anc e  mat r ix isde fined as:

$ $\mat hb f {S}_{wi t h in} =\frac{ 1 }{n 
 of_the transition_matrix will result in_a shape_signature_that is_too_dependent on noise_and the individualness_of specific waveform to_be of any_use._Thus additional processing is necessary for further analysis; even a small set of states_(12_x 12)_will_result_in a feature vector with_high dimensionality (144 dimensions). While_a window_and overlap size is assumed for the slotting_to_address the irregular_sampling of the time series data, there are two_adjustable features associated with this analysis:_the kernel width_associated_with_the slotting and the_state space (alphabet) resolution. It is_apparent that a range of resolutions_and kernel width need to be tested_to determine best performance given a_generic supervised classifier. For these_purposes a_rapid initial classification algorithm, General_Quadratic Discriminate Analysis_[@Duda2012], was_implemented to estimate_the mis-classification rate (wrong decisions/total decisions)._Not all states_will be observed, i.e. the high_dimensional_feature vector will_have_information_contained in_a small subset_of_elements. Dimensionality_reduction_methods are often necessary for implementation_of_classification algorithms, in particular QDA where the_construction of a covariance_matrix_of a sparse feature_space can be problematic.

The reduction_of the large, sparse, feature vector_resulting from_the unpacking_of the Markov Matrix is performed via extended canonical variate analysis_or ECVA [@Norgaard2006]. The methodology for_ECVA has roots in_principle component_analysis_(PCA). PCA is_a_procedure performed_on large multidimensional datasets with the intent_of rotating_what is a set of possibly_correlated dimensions into a_set_of linearly uncorrelated variables [@Sch06]. The_transformation results in a dataset, where_the first principle component (dimension)_has_the_largest possible variance. PCA is_an unsupervised methodology, i.e. a priori_known labels for_the data being processed is not taken_into_consideration, thus a reduction in feature_dimensionality_and while it maximizes the variance_it_might_not maximize the linear separability_of the class space. In contrast_to PCA, Canonical Variate Analysis does take class labels_into considerations. The_variation between groups is maximized_resulting_in_a transformation that benefits the goal of separating classes. Given_a set_of data $\mathbf{x}$_with: $g$ different classes, $n_{i}$ observations of each class, and_$r\times r$ dimensions in each observation; following_@Johnson1992, the within-group and between-group covariance matrix is defined as:

$$\mathbf{S}_{within}=\frac{1}{n