k)^{\top}({{\bf x}}_{k+1}-{{\bf x}}_k) = -[({{\bf g}}({{\bf x}}_k)^{\top}{\bf a}){\bf b}^{\top}
    - ({{\bf g}}({{\bf x}}_k)^{\top}{\bf b}){\bf a}^{\top}]({{\bf x}}_k+{{\bf x}}_{k+1}).$$ For convenience, we choose $$\label{eq3-10}
    {\bf a}={{\bf x}}_k~~~~\text{and}~~~~{\bf b}=-\alpha{{\bf g}}({{\bf x}}_k).$$ Here, $\alpha$ is a positive parameter, which serves as a step size, so that we have some freedom to choose the next iterate. According to this selection and (\[eq3-06\]), we obtain $$\begin{aligned}
    {{\bf g}}({{\bf x}}_k)^{\top}({{\bf x}}_{k+1}-{{\bf x}}_k) &=& -\alpha\|{{\bf g}}({{\bf x}}_k)\|^2 {{\bf x}}_k^{\top}({{\bf x}}_k+{{\bf x}}_{k+1}) \\
      &=& -\alpha\|{{\bf g}}({{\bf x}}_k)\|^2 (1+{{\bf x}}_k^{\top}Q{{\bf x}}_k).\end{aligned}$$ Since $-1$ is not an eigenvalue of the orthogonal matrix $Q$, we have $1+{{\bf x}}_k^{\top}Q{{\bf x}}_k > 0$ for ${{\bf x}}_k^{\top}{{\bf x}}_k=1$. Therefore, the conclusion ${{\bf g}}({{\bf x}}_k)^{\top}({{\bf x}}_{k+1}-{{\bf x}}_k)<0$ holds for any positive step size $\alpha$.

We summarize the iterative process in the following Theorem.

Suppose that the new iterate ${{\bf x}}_{k+1}$ is generated by (\[eq3-07\]), (\[eq3-08\]), (\[eq3-09\]), and (\[eq3-10\]). Then, the following assertions hold.

-   The iterative scheme is $$\label{eq3-11}
            {{\bf x}}_{k+1}(\alpha) = \frac{1-\alpha^2\|{{\bf g}}({{\bf x}}_k)\|^2}{1+\alpha^2\|{{\bf g}}({{\bf x}}_k)\|^2}{{\bf x}}_k
              -\frac{2\alpha}{1+\alpha^
k)^{\top}({{\bf x}}_{k+1}-{{\bf x}}_k) = -[({{\bf g}}({{\bf x}}_k)^{\top}{\bf a}){\bf b}^{\top } 
     - ({ { \bf g}}({{\bf x}}_k)^{\top}{\bf b}){\bf a}^{\top}]({{\bf x}}_k+{{\bf x}}_{k+1}).$$ For convenience, we choose $ $ \label{eq3 - 10 } 
     { \bf a}={{\bf x}}_k~~~~\text{and}~~~~{\bf b}=-\alpha{{\bf g}}({{\bf x}}_k).$$ Here, $ \alpha$ is a positive parameter, which serves as a gradation size, so that we take some freedom to choose the next iterate. According to this choice and (\[eq3 - 06\ ]), we obtain $ $ \begin{aligned } 
     { { \bf g}}({{\bf x}}_k)^{\top}({{\bf x}}_{k+1}-{{\bf x}}_k) & = & -\alpha\|{{\bf g}}({{\bf x}}_k)\|^2 { { \bf x}}_k^{\top}({{\bf x}}_k+{{\bf x}}_{k+1 }) \\ 
       & = & -\alpha\|{{\bf g}}({{\bf x}}_k)\|^2 (1+{{\bf x}}_k^{\top}Q{{\bf x}}_k).\end{aligned}$$ Since $ -1 $ is not an eigenvalue of the orthogonal matrix $ Q$, we hold $ 1+{{\bf x}}_k^{\top}Q{{\bf x}}_k > 0 $ for $ { { \bf x}}_k^{\top}{{\bf x}}_k=1$. Therefore, the conclusion $ { { \bf g}}({{\bf x}}_k)^{\top}({{\bf x}}_{k+1}-{{\bf x}}_k)<0 $ holds for any convinced step size $ \alpha$. 

 We summarize the iterative summons in the following Theorem. 

 Suppose that the new iterate $ { { \bf x}}_{k+1}$ is render by (\[eq3 - 07\ ]), (\[eq3 - 08\ ]), (\[eq3 - 09\ ]), and (\[eq3 - 10\ ]). Then, the follow assertions hold. 

 -    The iterative scheme is $ $ \label{eq3 - 11 } 
             { { \bf x}}_{k+1}(\alpha) = \frac{1-\alpha^2\|{{\bf g}}({{\bf x}}_k)\|^2}{1+\alpha^2\|{{\bf g}}({{\bf x}}_k)\|^2}{{\bf x}}_k 
               -\frac{2\alpha}{1+\alpha^
k)^{\too}({{\bf x}}_{k+1}-{{\bf x}}_k) = -[({{\bf g}}({{\bf x}}_k)^{\tok}{\bf a}){\bf b}^{\top}
    - ({{\yd g}}({{\bf e}}_k)^{\top}{\bf b}){\bf a}^{\too}]({{\bf x}}_k+{{\bf x}}_{k+1}).$$ For convenience, xe cyoose $$\label{eq3-10}
    {\bf a}={{\bf x}}_k~~~~\tdxt{and}~~~~{\bf h}=-\alpha{{\bf g}}({{\bf z}}_k).$$ Here, $\al'ga$ is a positjye paxaneter, which setves as a stap size, so thad de have some freedom to choose the nevt iterstf. According to thix selsbtlon and (\[eq3-06\]), we obtain $$\begin{alignes}
    {{\bf g}}({{\bf x}}_k)^{\top}({{\bf c}}_{k+1}-{{\bf x}}_k) &=& -\alpha\|{{\bf g}}({{\bf x}}_k)\|^2 {{\bf x}}_k^{\tlp}({{\bf x}}_k+{{\bf x}}_{k+1}) \\
      &=& -\alpha\|{{\bf g}}({{\vf x}}_h)\|^2 (1+{{\bf x}}_k^{\top}Q{{\bf x}}_k).\end{aligned}$$ Since $-1$ ia not an eigenvalue of the orthugonak matrix $Q$, ww hwee $1+{{\bf x}}_k^{\top}W{{\bf x}}_h > 0$ for ${{\bf x}}_k^{\top}{{\bf x}}_n=1$. Theregore, the conclmsion ${{\bf g}}({{\bf x}}_k)^{\top}({{\bf x}}_{k+1}-{{\bf x}}_k)<0$ iolds for any positide step shzz $\alpha$.

We summarize tye iterdtiva pruxesr ih vhe folloainj Theorem.

Sulpose that rhe new iterate ${{\bf c}}_{k+1}$ px generated gy (\[eq3-07\]), (\[qq3-08\]), (\[eq3-09\]), and (\[eq3-10\]). Then, the following assertionv hkld.

-   The iterative schwme is $$\label{eq3-11}
            {{\bf x}}_{h+1}(\alpha) = \frac{1-\alpha^2\|{{\bf g}}({{\bf x}}_k)\|^2}{1+\alpha^2\|{{\bf g}}({{\bf x}}_k)\|^2}{{\bf x}}_k
              -\fvac{2\auphw}{1+\alpha^
k)^{\top}({{\bf x}}_{k+1}-{{\bf x}}_k) = -[({{\bf g}}({{\bf x}}_k)^{\top}{\bf - g}}({{\bf x}}_k)^{\top}{\bf a}^{\top}]({{\bf x}}_k+{{\bf x}}_{k+1}).$$ {\bf x}}_k~~~~\text{and}~~~~{\bf b}=-\alpha{{\bf g}}({{\bf Here, $\alpha$ is positive parameter, which serves as a size, so that we have some freedom to choose the next iterate. According this selection and (\[eq3-06\]), we obtain $$\begin{aligned} {{\bf g}}({{\bf x}}_k)^{\top}({{\bf x}}_{k+1}-{{\bf x}}_k) &=& g}}({{\bf {{\bf x}}_k+{{\bf \\ &=& -\alpha\|{{\bf g}}({{\bf x}}_k)\|^2 (1+{{\bf x}}_k^{\top}Q{{\bf x}}_k).\end{aligned}$$ Since $-1$ is not an eigenvalue of the matrix $Q$, we have $1+{{\bf x}}_k^{\top}Q{{\bf x}}_k > for ${{\bf x}}_k^{\top}{{\bf x}}_k=1$. the conclusion ${{\bf g}}({{\bf x}}_k)^{\top}({{\bf x}}_k)<0$ for any step $\alpha$. summarize the iterative in the following Theorem. Suppose that the new iterate ${{\bf x}}_{k+1}$ is generated by (\[eq3-07\]), (\[eq3-08\]), (\[eq3-09\]), (\[eq3-10\]). Then, assertions hold. The scheme $$\label{eq3-11} {{\bf x}}_{k+1}(\alpha) g}}({{\bf x}}_k)\|^2}{1+\alpha^2\|{{\bf g}}({{\bf x}}_k)\|^2}{{\bf x}}_k -\frac{2\alpha}{1+\alpha^
k)^{\top}({{\bf x}}_{k+1}-{{\bf x}}_k) = -[({{\bf g}}({{\bf x}}_k)^{\top}{\bf a}){\Bf b}^{\top}
    - ({{\bf g}}({{\bF x}}_k)^{\toP}{\bf B}){\bf A}^{\tOp}]({{\bf X}}_k+{{\bf X}}_{k+1}).$$ For convenienCE, we cHoose $$\label{eq3-10}
    {\bf a}={{\bf x}}_k~~~~\texT{and}~~~~{\bF b}=-\ALpha{{\BF g}}({{\Bf x}}_k).$$ HEre, $\alphA$ Is A POsiTiVe ParAmETeR, whicH seRves as a Step size, so ThaT wE have some freEDoM to choose tHe nExt iterate. AcCorDing to ThIs sELectiOn aNd (\[eq3-06\]), wE obtaiN $$\Begin{aLigned}
    {{\bf g}}({{\Bf X}}_K)^{\top}({{\bf X}}_{K+1}-{{\bf x}}_k) &=& -\alPHA\|{{\bF g}}({{\bf X}}_k)\|^2 {{\bf x}}_k^{\top}({{\bf x}}_k+{{\bf x}}_{k+1}) \\
      &=& -\ALpHA\|{{\bf g}}({{\bf x}}_k)\|^2 (1+{{\bf x}}_k^{\toP}Q{{\bf x}}_k).\EnD{AlIGNed}$$ sinCe $-1$ is not an eIgEnvalUE of the oRThOGONal MAtrix $Q$, we have $1+{{\bF x}}_k^{\top}Q{{\bf x}}_k > 0$ FOr ${{\bF x}}_k^{\top}{{\Bf X}}_k=1$. THEreforE, the cOnCLusIon ${{\bf g}}({{\bf x}}_k)^{\tOp}({{\bf X}}_{k+1}-{{\bf x}}_k)<0$ holDs for aNY positiVE step siZe $\alphA$.

We SumMariZE tHe IteRaTIve PRoCesS In tHe followInG THeoreM.

SupPOSE That The New iTeratE ${{\bf x}}_{k+1}$ is generaTed By (\[eq3-07\]), (\[EQ3-08\]), (\[eq3-09\]), And (\[eq3-10\]). then, tHe foLlOwing AssertIons hOlD.

-   The iterative scHeme Is $$\label{eq3-11}
            {{\Bf x}}_{K+1}(\aLphA) = \fRac{1-\alPHa^2\|{{\bf g}}({{\bF x}}_k)\|^2}{1+\AlpHa^2\|{{\bf g}}({{\bf X}}_k)\|^2}{{\bf x}}_k
              -\fRAc{2\aLpHA}{1+\ALpHa^
k)^{\top}({{\bf x}}_{k+1}- {{\bf x}}_ k) =-[( {{\ bf  g}} ({{\ bf x}}_k)^{\to p }{\b f a}){\bf b}^{\top}
   - ( {{ \ bf g } }( {{\bf  x}}_k) ^ {\ t o p}{ \b fb}) {\ b fa}^{\ top }]({{\b f x}}_k+{{ \bf  x }}_{k+1}).$$ Fo r convenie nce , we choose$$\ label{ eq 3-1 0 }
   {\ bf a} ={{\bf x}}_k~ ~~~\text{ an d }~~~~{ \ bf b}=- \ a lp ha{{ \bf g}}({{\bf x}} _ k) . $$ Here, $\alp ha$ is  a po s i tiv e p arameter,wh ich s e rves as as t e p s i ze, so that w e have some fre edom t ocho o se the  next  i t era te. Accordi ng t o this se lectio n  and (\ [ eq3-06\ ]), we  ob tai n $$ \ be gi n{a li g ned } 
  { {\b f g}}({{ \b fx}}_k )^{\ t o p } ({{\ bfx}}_ {k+1} -{{\bf x}}_k)  &= & -\ a lph a\|{{ \bf g }}({ {\ bf x} }_k)\| ^2 {{ \b f x}}_k^{\top}( {{\b f x}}_k+{ {\b fx}} _{ k+1}) \\
    &=&  -\alph a\|{{\b f  g} }( { { \ bf  x}}_k)\|^2 (1+{{\ bf x }} _k^{\top }Q{{\b f  x }} _ k).\end{ al ign ed}$ $ Since  $-1 $  i s not an  eigen v al ue  of the  o rthogo na l m atr ix $Q $ , we  have$1+{{\bf  x}}_ k ^{\top}Q{{\bfx }}_k > 0$ for ${ { \ bf x}}_ k^{ \top}{{\bfx}}_ k =1$.  The r ef ore ,  theconcl us i on ${{\bf g}}({{\bf x} }_ k)^{\t op}({ {\bf x}}_{k+1 }-{{\bf x} } _ k )<0$ hol ds f o ra ny positive st ep si ze $\alpha $ .

We su mmari ze the i terativep r ocess in  th e f oll owi n g  T heorem.

Supp o s e th at  the ne w i terate${{ \bf  x} }_{ k+ 1}$ is ge neratedby  ( \[ eq 3-0 7\]), (\[eq3-0 8\ ]),  ( \[e q3-09 \ ]), an d (\[ eq3- 10 \] ) . T hen, th e  f o l lowi ng  a sser tio ns  hold .

-   T he iter ative sch eme is $ $\ la bel{eq3 -11}
          {{\bf x} }_ {k+ 1}(\al p h a) = \fr ac{1-\alpha^2\|{{\bf g} } ({{\bfx}} _k)\| ^2}{ 1+\alpha^ 2\| {{\bfg}} ( {{\bfx}}_k) \|^2} {{ \bf x }}_k         -\fra c { 2\a lpha} {1 +\al pha^
k)^{\top}({{\bf x}}_{k+1}-{{\bf_x}}_k) =_-[({{\bf g}}({{\bf x}}_k)^{\top}{\bf a}){\bf_b}^{\top}
 __ -_({{\bf_g}}({{\bf x}}_k)^{\top}{\bf b}){\bf_a}^{\top}]({{\bf x}}_k+{{\bf x}}_{k+1}).$$_For convenience, we choose_$$\label{eq3-10}
  __{\bf a}={{\bf x}}_k~~~~\text{and}~~~~{\bf b}=-\alpha{{\bf g}}({{\bf x}}_k).$$ Here, $\alpha$ is a positive parameter, which serves_as_a step_size,_so_that we have some freedom_to choose the next iterate._According to_this selection and (\[eq3-06\]), we obtain $$\begin{aligned}
 __ {{\bf g}}({{\bf_x}}_k)^{\top}({{\bf x}}_{k+1}-{{\bf x}}_k) &=& -\alpha\|{{\bf g}}({{\bf x}}_k)\|^2 {{\bf x}}_k^{\top}({{\bf_x}}_k+{{\bf x}}_{k+1}) \\
   _  &=&_-\alpha\|{{\bf_g}}({{\bf_x}}_k)\|^2 (1+{{\bf x}}_k^{\top}Q{{\bf x}}_k).\end{aligned}$$_Since $-1$ is not an eigenvalue_of the orthogonal matrix $Q$, we_have $1+{{\bf x}}_k^{\top}Q{{\bf x}}_k > 0$ for_${{\bf x}}_k^{\top}{{\bf x}}_k=1$. Therefore, the conclusion_${{\bf g}}({{\bf x}}_k)^{\top}({{\bf x}}_{k+1}-{{\bf x}}_k)<0$_holds for_any positive step size $\alpha$.

We_summarize the iterative_process in_the following Theorem.

Suppose_that the new iterate ${{\bf x}}_{k+1}$_is generated by_(\[eq3-07\]), (\[eq3-08\]), (\[eq3-09\]), and (\[eq3-10\]). Then,_the_following assertions hold.

-___The iterative_scheme is $$\label{eq3-11}
__ __     __{{\bf x}}_{k+1}(\alpha) = \frac{1-\alpha^2\|{{\bf g}}({{\bf x}}_k)\|^2}{1+\alpha^2\|{{\bf g}}({{\bf_x}}_k)\|^2}{{\bf x}}_k
  __   _    _ -\frac{2\alpha}{1+\alpha^