|{\boldsymbol{x}}\|\big\}.$$ Pick $({\boldsymbol{x}}_1,y_1)\in\mathcal{G}$ with $\|{\boldsymbol{x}}_1\|=Z$. The point $({\boldsymbol{x}}_1,y_1)$ is in the compact set $$\mathcal{B}_Z=\big\{{\boldsymbol{x}}\in{\mathbb{R}}^m:\|{\boldsymbol{x}}\|=Z\big\}\times\mathcal{A}.$$ Let $\big({\boldsymbol{x}}_1^*,y^*({\boldsymbol{x}}_1^*)\big)\in\mathcal{B}_Z$ be any point where $f$ is maximized over $\mathcal{B}_Z$. By $({\boldsymbol{x}}_1,y_1)\in\mathcal{G}$, we have $$\label{eqn:xpping}
f^*({\boldsymbol{x}}_1^*)-f^*({\boldsymbol{0}})\geq f({\boldsymbol{x}}_1,y_1)-f^*({\boldsymbol{0}})\geq0.9\varepsilon\cdot\|{\boldsymbol{x}}_1\|=0.9\varepsilon\cdot\|{\boldsymbol{x}}_1^*\|.$$ By (\[eqn:bigderivative\]), there must be an ${\boldsymbol{x}}_2\neq{\boldsymbol{x}}_1^*$ such that $$\label{eqn:xpppdef}
f^*({\boldsymbol{x}}_2)-f^*({\boldsymbol{x}}_1^*)\geq f\big({\boldsymbol{x}}_2,y^*({\boldsymbol{x}}_1^*)\big)-f\big({\boldsymbol{x}}_1^*,y^*({\boldsymbol{x}}_1^*)\big)\geq0.9\varepsilon\cdot\|{\boldsymbol{x}}_2-{\boldsymbol{x}}_1^*\|.$$ Note that $f^*({\boldsymbol{x}}_2)$ is strictly greater than $f^*({\boldsymbol{x}}_1^*)$. By the maximality of $f\big({\boldsymbol{x}}_1^*,y^*({\boldsymbol{x}}_1^*)\big)$ on $\mathcal{B}_Z$, we can see $\|{\boldsymbol{x}}_2\|\neq Z$. There are two cases:

1.  $\|{\boldsymbol{x}}_2\|<Z$. This implies that the maximum value of $f$ over $$\mathcal{B}_{\leq Z}=\big\{{\boldsymbol{x}}\in{\mathbb{R}}^m:\|{\boldsymbol{x}}\|\leq
|{\boldsymbol{x}}\|\big\}.$$ Pick $ ({ \boldsymbol{x}}_1,y_1)\in\mathcal{G}$ with $ \|{\boldsymbol{x}}_1\|=Z$. The point $ ({ \boldsymbol{x}}_1,y_1)$ is in the compact set $ $ \mathcal{B}_Z=\big\{{\boldsymbol{x}}\in{\mathbb{R}}^m:\|{\boldsymbol{x}}\|=Z\big\}\times\mathcal{A}.$$ Let $ \big({\boldsymbol{x}}_1^*,y^*({\boldsymbol{x}}_1^*)\big)\in\mathcal{B}_Z$ be any item where $ f$ is maximize over $ \mathcal{B}_Z$. By $ ({ \boldsymbol{x}}_1,y_1)\in\mathcal{G}$, we have $ $ \label{eqn: xpping } 
 f^*({\boldsymbol{x}}_1^*)-f^*({\boldsymbol{0}})\geq f({\boldsymbol{x}}_1,y_1)-f^*({\boldsymbol{0}})\geq0.9\varepsilon\cdot\|{\boldsymbol{x}}_1\|=0.9\varepsilon\cdot\|{\boldsymbol{x}}_1^*\|.$$ By   (\[eqn: bigderivative\ ]), there must be an $ { \boldsymbol{x}}_2\neq{\boldsymbol{x}}_1^*$ such that $ $ \label{eqn: xpppdef } 
 f^*({\boldsymbol{x}}_2)-f^*({\boldsymbol{x}}_1^*)\geq f\big({\boldsymbol{x}}_2,y^*({\boldsymbol{x}}_1^*)\big)-f\big({\boldsymbol{x}}_1^*,y^*({\boldsymbol{x}}_1^*)\big)\geq0.9\varepsilon\cdot\|{\boldsymbol{x}}_2-{\boldsymbol{x}}_1^*\|.$$ Note that $ f^*({\boldsymbol{x}}_2)$ is strictly great than $ f^*({\boldsymbol{x}}_1^*)$. By the maximality of $ f\big({\boldsymbol{x}}_1^*,y^*({\boldsymbol{x}}_1^*)\big)$ on $ \mathcal{B}_Z$, we can see $ \|{\boldsymbol{x}}_2\|\neq Z$. There are two case: 

 1.   $ \|{\boldsymbol{x}}_2\|<Z$. This implies that the maximum value of $ f$ over $ $ \mathcal{B}_{\leq Z}=\big\{{\boldsymbol{x}}\in{\mathbb{R}}^m:\|{\boldsymbol{x}}\|\leq
|{\bolfsymbol{x}}\|\big\}.$$ Pick $({\boldsymnol{x}}_1,y_1)\in\mathcal{G}$ cuth $\|{\bondsymbkl{x}}_1\|=Z$. The point $({\boldsymbol{x}}_1,y_1)$ is in thx conpact set $$\mathcal{B}_Z=\big\{{\boldshmbol{x}}\in{\mwthbb{R}}^m:\|{\bildsbmbol{x}}\|=Z\big\}\times\mefhcal{A}.$$ Let $\bif({\noldsvmuol{x}}_1^*,y^*({\boldsymbol{w}}_1^*)\big)\in\mathcdl{B}_Z$ be any pohng chere $f$ is maximized over $\mathcal{B}_Z$. Fy $({\boldxylbol{x}}_1,y_1)\in\mathcaj{G}$, wt hwve $$\mabel{eqn:xpping}
f^*({\boldsymbol{x}}_1^*)-f^*({\boldsymgol{0}})\geq h({\boldsymbol{x}}_1,y_1)-f^*({\bpldsymbol{0}})\geq0.9\varepsilon\cdot\|{\holddymbol{x}}_1\|=0.9\varepsilon\cfot\|{\boldsymbil{x}}_1^*\|.$$ Ft (\[eqn:bigderivxtive\]), thert kust be an ${\boldsymbol{x}}_2\neq{\boldsymbol{x}}_1^*$ such that $$\label{eqn:xk'pdev}
x^*({\boldsymbol{e}}_2)-f^*({\boldfymbol{x}}_1^*)\geq f\npg({\boldsfmbol{x}}_2,y^*({\noldsymbol{x}}_1^*)\big)-n\big({\bmldwymbol{x}}_1^*,y^*({\boldsymbol{x}}_1^*)\bij)\geq0.9\varepsilon\cdot\|{\bojdsymbol{x}}_2-{\tomdsymbol{x}}_1^*\|.$$ Note thqt $f^*({\bolgsymtol{x}}_2)$ us rtrjcvly greatfr vhan $f^*({\boldsgmbol{x}}_1^*)$. By tye maximality of $f\bog({\fildsymbol{x}}_1^*,y^*({\bomdsymbjl{v}}_1^*)\big)$ on $\mathcal{B}_Z$, we can see $\|{\boldsymbol{q}}_2\|\neq Z$. There are two cases:

1.  $\|{\boldsymbol{x}}_2\|<Z$. This imklies that the maximum value of $f$ over $$\mathcal{B}_{\leq Z}=\big\{{\boldvymbom{b}}\in{\nabhbb{F}}^n:\|{\blldsymbol{x}}\|\leq
|{\boldsymbol{x}}\|\big\}.$$ Pick $({\boldsymbol{x}}_1,y_1)\in\mathcal{G}$ with $\|{\boldsymbol{x}}_1\|=Z$. The point in compact set Let $\big({\boldsymbol{x}}_1^*,y^*({\boldsymbol{x}}_1^*)\big)\in\mathcal{B}_Z$ be maximized $\mathcal{B}_Z$. By $({\boldsymbol{x}}_1,y_1)\in\mathcal{G}$, have $$\label{eqn:xpping} f^*({\boldsymbol{x}}_1^*)-f^*({\boldsymbol{0}})\geq By (\[eqn:bigderivative\]), there must be an such that $$\label{eqn:xpppdef} f^*({\boldsymbol{x}}_2)-f^*({\boldsymbol{x}}_1^*)\geq f\big({\boldsymbol{x}}_2,y^*({\boldsymbol{x}}_1^*)\big)-f\big({\boldsymbol{x}}_1^*,y^*({\boldsymbol{x}}_1^*)\big)\geq0.9\varepsilon\cdot\|{\boldsymbol{x}}_2-{\boldsymbol{x}}_1^*\|.$$ Note that $f^*({\boldsymbol{x}}_2)$ is strictly greater than $f^*({\boldsymbol{x}}_1^*)$. the maximality of $f\big({\boldsymbol{x}}_1^*,y^*({\boldsymbol{x}}_1^*)\big)$ on $\mathcal{B}_Z$, we can see $\|{\boldsymbol{x}}_2\|\neq Z$. There are cases: $\|{\boldsymbol{x}}_2\|<Z$. implies the maximum value of $f$ over $$\mathcal{B}_{\leq Z}=\big\{{\boldsymbol{x}}\in{\mathbb{R}}^m:\|{\boldsymbol{x}}\|\leq
|{\boldsymbol{x}}\|\big\}.$$ Pick $({\boldsymBol{x}}_1,y_1)\in\matHcal{G}$ WitH $\|{\boLdSymbOl{x}}_1\|=Z$. the point $({\boldsyMBol{x}}_1,Y_1)$ is in the compact set $$\mathCal{B}_Z=\BiG\{{\BoldSYmBol{x}}\iN{\mathbb{r}}^M:\|{\bOLDsyMbOl{X}}\|=Z\bIg\}\TImEs\matHcaL{A}.$$ Let $\biG({\boldsymboL{x}}_1^*,y^*({\BoLdsymbol{x}}_1^*)\big)\IN\mAthcal{B}_Z$ be Any Point where $f$ iS maXimizeD oVer $\MAthcaL{B}_Z$. by $({\bolDsymboL{X}}_1,y_1)\in\maThcal{G}$, we hAvE $$\Label{eQN:xpping}
F^*({\BOlDsymBol{x}}_1^*)-f^*({\boldsymbol{0}})\geQ F({\bOLdsymbol{x}}_1,y_1)-f^*({\bolDsymboL{0}})\gEQ0.9\vAREpsIloN\cdot\|{\boldsYmBol{x}}_1\|=0.9\vARepsiloN\CdOT\|{\BOldSYmbol{x}}_1^*\|.$$ By (\[eqn:biGderivative\]), THerE must bE aN ${\boLDsymboL{x}}_2\neq{\BoLDsyMbol{x}}_1^*$ such thAt $$\laBel{eqn:xppPdef}
f^*({\bOLdsymboL{X}}_2)-f^*({\boldsYmbol{x}}_1^*)\Geq F\biG({\bolDSyMbOl{x}}_2,Y^*({\bOLdsYMbOl{x}}_1^*)\BIg)-f\Big({\boldsYmBoL{x}}_1^*,y^*({\boLdsyMBOL{X}}_1^*)\big)\Geq0.9\VarePsiloN\cdot\|{\boldsymbOl{x}}_2-{\BoldSYmbOl{x}}_1^*\|.$$ NoTe thaT $f^*({\boLdSymboL{x}}_2)$ is stRictlY gReater than $f^*({\boldSymbOl{x}}_1^*)$. By the mAxiMaLitY oF $f\big({\BOldsymBol{X}}_1^*,y^*({\bOldsymbOl{x}}_1^*)\big)$ oN $\MatHcAL{b}_z$, wE can see $\|{\boldsymbol{x}}_2\|\NeQ z$. thEre are twO cases:

1.  $\|{\BOlDsYMbol{x}}_2\|<Z$. ThIs ImpLies THAt the MaxiMUm Value of $f$ Over $$\maTHcAl{b}_{\leq Z}=\biG\{{\bOldsymBoL{x}}\iN{\maThbb{R}}^M:\|{\BoldSymbol{X}}\|\leq
|{\boldsymbol{x}}\|\big\}. $$ Pick $( {\bol dsy mbo l{ x}}_ 1,y_ 1)\in\mathcal{ G }$ w ith $\|{\boldsymbol{x} }_1\| =Z $ . Th e  p oint$({\bol d sy m b ol{ x} }_ 1,y _1 ) $is in  th e compa ct set $$\ mat hc al{B}_Z=\big \ {{ \boldsymbo l{x }}\in{\mathb b{R }}^m:\ |{ \bo l dsymb ol{ x}}\| =Z\big \ }\time s\mathcal {A } .$$ Le t  $\big( { \ bo ldsy mbol{x}}_1^*,y^*( { \b o ldsymbol{x}}_1 ^*)\bi g) \ in \ m ath cal {B}_Z$ bean y poi n t where $f $ i s m a ximized over$\mathcal{B } _Z$ . By $ ({ \bo l dsymbo l{x}} _1 , y_1 )\in\mathca l{G} $, we hav e $$\l a bel{eqn : xpping} 
f^*({ \bo lds ymbo l {x }} _1^ *) - f^* ( {\ bol d sym bol{0}}) \g eq  f({\ bold s y m b ol{x }}_ 1,y_ 1)-f^ *({\boldsymbo l{0 }})\ g eq0 .9\va repsi lon\ cd ot\|{ \bolds ymbol {x }}_1\|=0.9\vare psil on\cdot\| {\b ol dsy mb ol{x} } _1^*\| .$$  By  (\[eqn :bigder i vat iv e \ ] ),  there must be an${ \ b ol dsymbol{ x}}_2\ n eq {\ b oldsymbo l{ x}} _1^* $ suchthat $$ \label{e qn:xpp p de f} 
f^*({\ bo ldsymb ol {x} }_2 )-f^* ( {\bo ldsymb ol{x}}_1 ^*)\g e q f\big({\bold s ymbol{x}}_2,y ^ *( { \ bo l dsym bol {x}}_1^*)\b ig)- f \big ({\b o ld sym b ol{x} }_1^* ,y ^ *( { \boldsymbol{x}}_1^* )\ big)\g eq0.9 \varepsilon\c dot\|{\bol d s y mbol{x}} _2-{ \ bo l dsymbol{x}}_1^ *\|.$ $ Note tha t  $f^*({\ bolds ymbol{x} }_2)$ iss t rictly g rea ter  th an$ f ^* ({\boldsymbol { x }}_1 ^* )$. Bythe  maxima lit y o f $ f\b ig ({\boldsy mbol{x}} _1 ^* ,y ^* ({\ bolds y mbol{x}} _1 ^*) \b ig) $ on$ \mathc al{B} _Z$,  w ec ansee $\| { \b o l dsym bo l{ x}}_ 2\| \n eq Z$ . Th e reare two  cases:
1.$\|{ \b ol dsymbol {x}}_2\|<Z$.Th is implies  t hat  the m a x imum val ue of $f$ over $$\mathc a l{B}_{\ leq  Z}=\ big\ {{\boldsy mbo l{x}}\ in{ \ mathbb {R}}^m :\|{\ bo lds y m bol{x } } \| \le q
|{\boldsymbol{x}}\|\big\}.$$ Pick_$({\boldsymbol{x}}_1,y_1)\in\mathcal{G}$ with_$\|{\boldsymbol{x}}_1\|=Z$. The point $({\boldsymbol{x}}_1,y_1)$_is in_the_compact set_$$\mathcal{B}_Z=\big\{{\boldsymbol{x}}\in{\mathbb{R}}^m:\|{\boldsymbol{x}}\|=Z\big\}\times\mathcal{A}.$$_Let $\big({\boldsymbol{x}}_1^*,y^*({\boldsymbol{x}}_1^*)\big)\in\mathcal{B}_Z$ be_any point where_$f$ is maximized over_$\mathcal{B}_Z$. By $({\boldsymbol{x}}_1,y_1)\in\mathcal{G}$,_we_have $$\label{eqn:xpping}
f^*({\boldsymbol{x}}_1^*)-f^*({\boldsymbol{0}})\geq f({\boldsymbol{x}}_1,y_1)-f^*({\boldsymbol{0}})\geq0.9\varepsilon\cdot\|{\boldsymbol{x}}_1\|=0.9\varepsilon\cdot\|{\boldsymbol{x}}_1^*\|.$$ By (\[eqn:bigderivative\]), there must be an ${\boldsymbol{x}}_2\neq{\boldsymbol{x}}_1^*$ such that $$\label{eqn:xpppdef}
f^*({\boldsymbol{x}}_2)-f^*({\boldsymbol{x}}_1^*)\geq f\big({\boldsymbol{x}}_2,y^*({\boldsymbol{x}}_1^*)\big)-f\big({\boldsymbol{x}}_1^*,y^*({\boldsymbol{x}}_1^*)\big)\geq0.9\varepsilon\cdot\|{\boldsymbol{x}}_2-{\boldsymbol{x}}_1^*\|.$$ Note_that_$f^*({\boldsymbol{x}}_2)$ is_strictly_greater_than $f^*({\boldsymbol{x}}_1^*)$. By the maximality_of $f\big({\boldsymbol{x}}_1^*,y^*({\boldsymbol{x}}_1^*)\big)$ on $\mathcal{B}_Z$, we_can see_$\|{\boldsymbol{x}}_2\|\neq Z$. There are two cases:

1.  $\|{\boldsymbol{x}}_2\|<Z$._This_implies that the_maximum value of $f$ over $$\mathcal{B}_{\leq Z}=\big\{{\boldsymbol{x}}\in{\mathbb{R}}^m:\|{\boldsymbol{x}}\|\leq