 {\Pi}(\bar{\theta}; {\mathcal{S}}_{k,d}).\end{aligned}$$

Using, the statement of the can be alternatively represented as $$\begin{aligned}
\label{dual-norm-characterization}
    ({\|\beta\|}_{k\square d}^\star)^2
    =({\|\bar{\beta}\|}_{k\square d}^\star)^2 
    = \sup_{A\in {\overline{\texttt{BD}}}(k,d)} \, \bar{\beta}^{{\sf T}}A \bar{\beta}\end{aligned}$$ where $\bar{\beta}$ is nonnegative and non-increasing, and ${\overline{\texttt{BD}}}(k,d)$ is the set of block diagonal matrices with $d$ blocks exactly covering the first $k$ rows and columns and zero elsewhere, where on each block of size $q$, all of the entries are equal to $\frac{1}{q}$. Note that if the input is not a sorted nonnegative vector, then we need to consider ${\texttt{BD}}(k,d)\equiv\{PAP^{{\sf T}}:P\in \mathcal{P}_\pm,A\in{\overline{\texttt{BD}}}(k,d)\}$, where $\mathcal{P}_\pm $ is the set of signed permutation matrices. This brings us to $$\begin{aligned}
\label{dual-norm-var}
    ({\|\beta\|}_{k\square d}^\star)^2
    = \sup_{A\in {\texttt{BD}}(k,d)} \, \beta^{{\sf T}}A \beta.\end{aligned}$$ The aforementioned representations, in,, and, all depend on an efficient characterization of combinatorial sets such as ${\bar{\texttt{P}}}(k,d)$ or ${\texttt{BD}}(k,d)$. below shows that ${\texttt{BD}}(k,d)$ is of exponential size, which renders direct optimization inefficient.

\[lem:BD-size\] $|{\texttt{BD}}(k,d)| < (\frac{2epd}{k})^k$.

is proved in.

Next, we review a dynamic programming approach to reformulate the above in terms of a quadratic program.

### A Dynamic Program and a QCQP Representation {#sec:qcqp}

Consider a non-negative sorted vector $\bar{\beta}$ with $\bar{\beta}_1\geq \cdots \geq \bar{\beta
{ \Pi}(\bar{\theta }; { \mathcal{S}}_{k, d}).\end{aligned}$$ 

 Using, the statement of the can be alternatively represented as $ $ \begin{aligned } 
 \label{dual - norm - word picture } 
     ({ \|\beta\|}_{k\square d}^\star)^2 
     =( { \|\bar{\beta}\|}_{k\square d}^\star)^2 
     = \sup_{A\in { \overline{\texttt{BD}}}(k, d) } \, \bar{\beta}^{{\sf T}}A \bar{\beta}\end{aligned}$$ where $ \bar{\beta}$ is nonnegative and non - increasing, and $ { \overline{\texttt{BD}}}(k, d)$ is the hardening of block diagonal matrices with $ d$ block exactly covering the beginning $ k$ course and columns and zero elsewhere, where on each pulley of size $ q$, all of the entries are equal to   $ \frac{1}{q}$. Note that if the stimulation is not a sorted nonnegative vector, then we need to regard $ { \texttt{BD}}(k, d)\equiv\{PAP^{{\sf T}}:P\in \mathcal{P}_\pm, A\in{\overline{\texttt{BD}}}(k, d)\}$, where $ \mathcal{P}_\pm $ is the set of sign permutation matrices. This fetch us to $ $ \begin{aligned } 
 \label{dual - norm - var } 
     ({ \|\beta\|}_{k\square d}^\star)^2 
     = \sup_{A\in { \texttt{BD}}(k, d) } \, \beta^{{\sf T}}A \beta.\end{aligned}$$ The aforementioned representation, in, , and, all depend on an efficient characterization of combinatorial sets such as $ { \bar{\texttt{P}}}(k, d)$ or $ { \texttt{BD}}(k, d)$. downstairs shows that $ { \texttt{BD}}(k, d)$ is of exponential size, which renders direct optimization inefficient. 

 \[lem: BD - size\ ] $ |{\texttt{BD}}(k, d)| < (\frac{2epd}{k})^k$. 

 is proved in. 

 Next, we review a active programming approach to reformulate the above in terms of a quadratic program. 

 # # # A Dynamic Program and a QCQP Representation { # sec: qcqp } 

 regard a non - minus sorted vector $ \bar{\beta}$ with $ \bar{\beta}_1\geq \cdots \geq \bar{\beta
 {\Pi}(\har{\theta}; {\mathcal{S}}_{k,d}).\end{allgned}$$

Using, the sjarement of ths can be alternatively represented ad $$\vegin{qligned}
\label{dual-norm-chxracterizwtion}
    ({\|\bete\|}_{k\square d}^\star)^2
    =({\|\bar{\beta}\|}_{k\squadc d}^\stcr)^2 
    = \sup_{A\in {\oyerline{\textdt{BD}}}(k,d)} \, \bar{\betd}^{{\sw C}}A \bar{\beta}\end{aligned}$$ where $\bar{\beta}$ if nonnebahive and non-insreaxyng, znd ${\overline{\texttt{BD}}}(k,d)$ is the set kf blocn diagonal mayrices with $d$ blocks exactpy clvering the first $n$ rows and xoluibs and zero dlsewhere, where on eacg block of size $q$, all of the engries are equal ti $\frww{1}{q}$. Note thav if tre input is kpt a smrted npnnegative vecbor, tien qe need to consider ${\txxttt{BD}}(k,d)\equiv\{PAP^{{\sf J}}:P\in \mathcdl{'}_\pm,A\in{\overline{\texttt{BE}}}(k,e)\}$, whete $\madhcau{P}_\pm $ ia vhe set ov smgned permufation matruces. This brings us tj $$\begin{aligned}
\mabel{dtaj-norm-var}
    ({\|\beta\|}_{k\square d}^\star)^2
    = \sup_{A\it {\tsxttt{BD}}(k,d)} \, \beta^{{\sf T}}A \bera.\end{aligned}$$ The aforgmentioned representations, in,, and, all depend on an efficiend chacaztexldatiub lf combinatorial sets such as ${\bar{\texttt{P}}}(k,d)$ or ${\fectnt{BD}}(k,d)$. below showf that ${\textyt{HD}}(l,q)$ is of expongntial sizs, which renders digect opjimizarion inefsicirnt.

\[lem:BD-size\] $|{\texttt{BD}}(k,d)| < (\frqc{2epd}{k})^k$.

is prjced in.

Next, we revizw a dynamic probrammong approach to reformuuate the above ln terms kw a quadratic prugrsm.

### A Dynamic Program and a QSQP Reprewentction {#sez:qcqk}

Considqr a non-nehativc sorted vector $\bar{\heta}$ cith $\tar{\beta}_1\geq \cdots \geq \bar{\beta
{\Pi}(\bar{\theta}; {\mathcal{S}}_{k,d}).\end{aligned}$$ Using, the statement of the alternatively as $$\begin{aligned} ({\|\beta\|}_{k\square d}^\star)^2 =({\|\bar{\beta}\|}_{k\square \bar{\beta}^{{\sf \bar{\beta}\end{aligned}$$ where $\bar{\beta}$ nonnegative and non-increasing, ${\overline{\texttt{BD}}}(k,d)$ is the set of block matrices with $d$ blocks exactly covering the first $k$ rows and columns and elsewhere, where on each block of size $q$, all of the entries are to Note if input is not a sorted nonnegative vector, then we need to consider ${\texttt{BD}}(k,d)\equiv\{PAP^{{\sf T}}:P\in \mathcal{P}_\pm,A\in{\overline{\texttt{BD}}}(k,d)\}$, where $ is the set of signed permutation matrices. brings us to $$\begin{aligned} ({\|\beta\|}_{k\square d}^\star)^2 = \sup_{A\in {\texttt{BD}}(k,d)} \beta^{{\sf \beta.\end{aligned}$$ The representations, and, depend on an characterization of combinatorial sets such as ${\bar{\texttt{P}}}(k,d)$ or ${\texttt{BD}}(k,d)$. below shows that ${\texttt{BD}}(k,d)$ is of exponential size, renders direct \[lem:BD-size\] $|{\texttt{BD}}(k,d)| (\frac{2epd}{k})^k$. proved Next, we review programming approach to reformulate the above a quadratic program. ### A Dynamic Program and QCQP Representation Consider a non-negative sorted vector $\bar{\beta}$ $\bar{\beta}_1\geq \cdots \geq \bar{\beta
 {\Pi}(\bar{\theta}; {\mathcal{S}}_{k,d}).\end{alIgned}$$

Using, The stAteMenT oF the Can bE alternatively REpreSented as $$\begin{aligned}
\laBel{duAl-NOrm-cHArActerIzation}
    ({\|\BEtA\|}_{K\SquArE d}^\StaR)^2
    =({\|\bAR{\bEta}\|}_{k\sQuaRe d}^\star)^2 
    = \Sup_{A\in {\overLinE{\tExttt{BD}}}(k,d)} \, \bar{\BEtA}^{{\sf T}}A \bar{\beTa}\eNd{aligned}$$ wheRe $\bAr{\beta}$ Is NonNEgatiVe aNd non-IncreaSIng, and ${\Overline{\tExTTt{BD}}}(k,d)$ IS the set OF BlOck dIagonal matrices wiTH $d$ BLocks exactly coVering ThE FiRST $k$ rOws And columns AnD zero ELsewherE, WhERE On eACh block of size $Q$, all of the enTRieS are eqUaL to $\FRac{1}{q}$. NoTe thaT iF The Input is not a SortEd nonnegaTive veCTor, then WE need to ConsidEr ${\tExtTt{BD}}(K,D)\eQuIv\{PaP^{{\SF T}}:P\IN \mAthCAl{P}_\Pm,A\in{\oveRlInE{\textTt{BD}}}(K,D)\}$, WHEre $\mAthCal{P}_\Pm $ is tHe set of signed PerMutaTIon MatriCes. ThIs brInGs us tO $$\begin{AlignEd}
\Label{dual-norm-vaR}
    ({\|\betA\|}_{k\square d}^\StaR)^2
    = \sUp_{A\In {\TexttT{bD}}(k,d)} \, \beTa^{{\sF T}}A \Beta.\end{Aligned}$$ tHe aFoREMEnTioned representatiOnS, IN,, aNd, all depEnd on aN EfFiCIent charAcTerIzatION of coMbinAToRial sets Such as ${\BAr{\TeXttt{P}}}(k,d)$ Or ${\Texttt{bD}}(K,d)$. bEloW showS That ${\Texttt{bD}}(k,d)$ is of ExponENtial size, which REnders direct oPTiMIZaTIon iNefFicient.

\[lem:Bd-sizE\] $|{\TextTt{BD}}(K,D)| < (\fRac{2EPd}{k})^k$.

iS provEd IN.

NEXt, we review a dynamic pRoGrammiNg appRoach to reformUlate the abOVE In terms oF a quADrATic program.

### A DynAmic PRogram and a qcQP RepreSentaTion {#sec:qCqp}

ConsidER A non-negaTivE soRteD veCTOr $\Bar{\beta}$ with $\baR{\BEta}_1\gEq \Cdots \geQ \baR{\beta
 {\Pi}(\bar{\theta}; {\mat hcal{S}}_{ k,d}) .\e nd{ al igne d}$$ 

Using, the s t atem ent of the can be alte rnati ve l y re p re sente d as $$ \ be g i n{a li gn ed} 
\ l ab el{du al- norm-ch aracteriza tio n} 
    ({\|\be t a\ |}_{k\squa red}^\star)^2   =({\| \b ar{ \ beta} \|} _{k\s quared }^\sta r)^2 
   = \sup_{ A \in {\o v e rl ine{ \texttt{BD}}}(k,d ) }\ , \bar{\beta}^ {{\sfT} } A\ b ar{ \be ta}\end{al ig ned}$ $  where$ \b a r { \be t a}$ is nonneg ative and n o n-i ncreas in g,a nd ${\ overl in e {\t exttt{BD}}} (k,d )$ is the  set o f  blockd iagonal  matri ces  wi th $ d $bl ock se xac t ly  co v eri ng the f ir st  $k$rows a n d  col umn s an d zer o elsewhere,whe re o n  ea ch bl ock o f si ze  $q$,  all o f the  e ntries are equa l to  $\frac{1 }{q }$ . N ot e tha t  if th e i npu t is no t a sor t edno n n e ga tive vector, thenwe n ee d to con sider$ {\ te x ttt{BD}} (k ,d) \equ i v \{PAP ^{{\ s fT}}:P\in  \math c al {P }_\pm,A \i n{\ove rl ine {\t exttt { BD}} }(k,d) \}$, whe re $\ m athcal{P}_\pm$  is the set o f  s i g ne d  per mut ation matri ces. This  bri n gs  us to $$ \begi n{ a li g ned}
\label{dual-no rm -var}    ( {\|\beta\|}_{ k\square d } ^ \ star)^2   =  \ s up_{A\in {\tex ttt{B D}}(k,d)}\ , \beta^ {{\sf  T}}A \b eta.\end{ a l igned}$$  Th e a for eme n t io ned represent a t ions ,in,, an d,all dep end  on  an  ef fi cient cha racteriz at io nof  co mbina t orial se ts  su ch  as  ${\b a r{\tex ttt{P }}}( k, d) $  or  ${\tex t tt { B D}}( k, d) $. b elo wshows  tha t  ${ \texttt {BD}}(k,d )$i s of  e xp onentia l size, which  r enders dir ec t o ptimiz a t ion inef ficient.

\[lem:BD-size \ ] $|{\t ext tt{BD }}(k ,d)| < (\ fra c{2epd }{k } )^k$.
is pr ovedin .
N e xt, w e re vie wa dynamicp r ogr ammin gappr oach to  reformulate the a b ove  in terms ofa q uadr a t ic  pr o gr a m.
# # # A D ynamic Programand a QCQP  R e pr esentation {#s ec :qcqp}
Consid er an on-nega tive sort ed vector  $ \bar { \ bet a}$ with $ \bar{\be ta}_1\geq \cdot s  \ geq \ bar {\beta 
 {\Pi}(\bar{\theta};_{\mathcal{S}}_{k,d}).\end{aligned}$$

Using, the_statement of the can_be alternatively_represented_as $$\begin{aligned}
\label{dual-norm-characterization}
__  ({\|\beta\|}_{k\square_d}^\star)^2
  _ =({\|\bar{\beta}\|}_{k\square d}^\star)^2 
_  _=_\sup_{A\in {\overline{\texttt{BD}}}(k,d)} \, \bar{\beta}^{{\sf T}}A \bar{\beta}\end{aligned}$$ where $\bar{\beta}$ is nonnegative and non-increasing, and ${\overline{\texttt{BD}}}(k,d)$_is_the set_of_block_diagonal matrices with $d$ blocks_exactly covering the first $k$_rows and_columns and zero elsewhere, where on each block_of_size $q$, all_of the entries are equal to $\frac{1}{q}$. Note that if_the input is not a sorted_nonnegative vector, then_we_need_to consider ${\texttt{BD}}(k,d)\equiv\{PAP^{{\sf T}}:P\in_\mathcal{P}_\pm,A\in{\overline{\texttt{BD}}}(k,d)\}$, where $\mathcal{P}_\pm $ is the_set of signed permutation matrices. This_brings us to $$\begin{aligned}
\label{dual-norm-var}
   _({\|\beta\|}_{k\square d}^\star)^2
    =_\sup_{A\in {\texttt{BD}}(k,d)} \, \beta^{{\sf T}}A_\beta.\end{aligned}$$ The_aforementioned representations, in,, and, all_depend on an_efficient characterization_of combinatorial sets_such as ${\bar{\texttt{P}}}(k,d)$ or ${\texttt{BD}}(k,d)$. below_shows that ${\texttt{BD}}(k,d)$_is of exponential size, which renders_direct_optimization inefficient.

\[lem:BD-size\] $|{\texttt{BD}}(k,d)|_<_(\frac{2epd}{k})^k$.

is_proved in.

Next,_we review a_dynamic_programming approach_to_reformulate the above in terms of_a_quadratic program.

### A Dynamic Program and a_QCQP Representation {#sec:qcqp}

Consider a_non-negative_sorted vector $\bar{\beta}$ with_$\bar{\beta}_1\geq \cdots \geq \bar{\beta