_i + b_0$$ where $b_0$ is the average rating, $b_u$ and $b_i$ are user and item biases, respectively. The estimation of parameters is to minimize the rating prediction error in the training dataset. The optimization objective function is $$\label{eq:ojf}
    \begin{split}
        \vspace{-2pt}
        \underset{p*,q*}{\text{min}} \frac{1}{2}\sum_{u,i} (r_{u,i} & -\hat{r}_{u,i})^2 + \frac{\mu_u}{2} ||\bm{p_u}||_2^2 + \frac{\mu_i}{2} ||\bm{q_i}||_2^2 \\
        & + \mu_w \sum_a||\bm{w_a}||_1 + \frac{\mu_b}{2} (||b_u||_2^2 + ||b_i||_2^2);
        \vspace{-2pt}
    \end{split}$$ where $||\cdot||_2$ denotes the $\ell_2$ norm for preventing model overfitting, and $||\cdot||_1$ denotes the $\ell_1$ norm. $\mu_u, \mu_i, \mu_w$, and $\mu_b$ are regularization parameters, which are tunable hyper-parameters. In practice, we relax the binary requirement of $\bm{w_a}$ by using $\ell_l$ norm. It is well known that $\ell_l$ regularization yields sparse solution of the weights [@mairal2010online]. The $\ell_2$ regularization of $\bm{p_u}$ and $\bm{q_i}$ prevents them to have arbitrarily large values, which would lead to arbitrarily small values of $\bm{w_a}$.

**Optimization.** We use the stochastic gradient descent (SGD) algorithm to learn the parameters by optimizing the objective function in Eq. \[eq:ojf\]. In each step of SGD, the localized optimization is performed on a rating $r_{u,i}$. Let $L$ denote the loss, and the gradients of parameters are given as follows: $$\begin{aligned}
\label{eq:user}
    \small
    \vspace{-2pt}
    
_ i + b_0$$ where $ b_0 $ is the average rating, $ b_u$ and $ b_i$ are user and item bias, respectively. The estimate of parameters is to minimize the rating prediction erroneousness in the training dataset. The optimization objective function is $ $ \label{eq: ojf } 
     \begin{split } 
         \vspace{-2pt } 
         \underset{p*,q*}{\text{min } } \frac{1}{2}\sum_{u, i } (r_{u, one } & -\hat{r}_{u, i})^2 + \frac{\mu_u}{2 } ||\bm{p_u}||_2 ^ 2 + \frac{\mu_i}{2 } ||\bm{q_i}||_2 ^ 2 \\ 
         & + \mu_w \sum_a||\bm{w_a}||_1 + \frac{\mu_b}{2 } (||b_u||_2 ^ 2 + ||b_i||_2 ^ 2); 
         \vspace{-2pt } 
     \end{split}$$ where $ ||\cdot||_2 $ denote the $ \ell_2 $ norm for preventing model overfitting, and $ ||\cdot||_1 $ denotes the $ \ell_1 $ average. $ \mu_u, \mu_i, \mu_w$, and $ \mu_b$ are regularization parameters, which are tunable hyper - parameters. In practice, we loosen the binary requirement of $ \bm{w_a}$ by using $ \ell_l$ norm. It is well known that $ \ell_l$ regularization output sparse solution of the weights   [ @mairal2010online ]. The $ \ell_2 $ regularization of $ \bm{p_u}$ and $ \bm{q_i}$ prevents them to consume arbitrarily large values, which would lead to randomly small value of $ \bm{w_a}$. 

 * * Optimization. * * We use the stochastic gradient descent (SGD) algorithm to learn the argument by optimizing the objective function in Eq.   \[eq: ojf\ ]. In each step of SGD, the localized optimization is performed on a rating $ r_{u, i}$. Let $ L$ denote the loss, and the gradients of parameters are given as follows: $ $ \begin{aligned } 
 \label{eq: user } 
     \small 
     \vspace{-2pt }
_i + h_0$$ where $b_0$ is the average rating, $b_u$ and $y_u$ are nser ans item bkases, respectively. The estimetiob of kcrameters is to minioize the gating prwdicuion error in the traininn datzdet. Chx optimization pbjective xunction is $$\lateu{ee:ojf}
    \begin{split}
        \vspace{-2pt}
        \inferset{p*,q*}{\text{mig}} \frss{1}{2}\sum_{h,p} (v_{u,i} & -\hat{r}_{u,i})^2 + \frac{\mu_u}{2} ||\bm{p_u}||_2^2 + \frac{\mh_i}{2} ||\bm{q_i}||_2^2 \\
        & + \mu_e \sum_a||\bm{w_a}||_1 + \frac{\mu_b}{2} (||b_u||_2^2 + ||b_i||_2^2);
        \vspace{-2pt}
    \enf{split}$$ wherg $||\cdjr||_2$ denotes thd $\ell_2$ norm for preventjng model overfitting, and $||\cdot||_1$ aenotzs the $\ell_1$ boem. $\lo_u, \mu_i, \mu_w$, aid $\mu_b$ are regularldation [arametrrs, which are bunabne yyper-parameters. In prectice, we relax the finary rexunrement of $\bm{w_a}$ by usunt $\ell_n$ nosm. Ig is weml khown tjat $\ell_l$ regumarization tields sparse solutoog of the weighfs [@mairwl2010jnline]. The $\ell_2$ regularization of $\bm{p_u}$ atd $\gm{q_i}$ prevents them to hqve arbitrarily large values, wrich would lead to arbitrarily small values of $\bm{f_a}$.

**Optmmkzauiin.** We ysf the stochastic gradient descent (SGD) algoritrj uo kearn the paraieters by oltlmoeing the objecjive fuudtjon in Eq. \[eq:ojf\]. In fach stgp of WGD, the ljcalozed optimization is perforned on a ratpng $e_{u,i}$. Let $L$ denote tke loss, and che grsdienys of parameters are giren as follows: $$\behin{alignes}
\uabel{eq:user}
    \soalk
    \vspact{-2ot}
    
_i + b_0$$ where $b_0$ is the $b_u$ $b_i$ are and item biases, is minimize the rating error in the dataset. The optimization objective function is \begin{split} \vspace{-2pt} \underset{p*,q*}{\text{min}} \frac{1}{2}\sum_{u,i} (r_{u,i} & -\hat{r}_{u,i})^2 + \frac{\mu_u}{2} ||\bm{p_u}||_2^2 + \frac{\mu_i}{2} ||\bm{q_i}||_2^2 & + \mu_w \sum_a||\bm{w_a}||_1 + \frac{\mu_b}{2} (||b_u||_2^2 + ||b_i||_2^2); \vspace{-2pt} \end{split}$$ where $||\cdot||_2$ the norm preventing overfitting, and $||\cdot||_1$ denotes the $\ell_1$ norm. $\mu_u, \mu_i, \mu_w$, and $\mu_b$ are regularization parameters, which tunable hyper-parameters. In practice, we relax the binary of $\bm{w_a}$ by using norm. It is well known $\ell_l$ yields sparse of weights The $\ell_2$ regularization $\bm{p_u}$ and $\bm{q_i}$ prevents them to have arbitrarily large values, which would lead to arbitrarily small values $\bm{w_a}$. **Optimization.** the stochastic descent algorithm learn the parameters the objective function in Eq. \[eq:ojf\]. of SGD, the localized optimization is performed on rating $r_{u,i}$. $L$ denote the loss, and the of parameters are given as follows: $$\begin{aligned} \label{eq:user} \vspace{-2pt}
_i + b_0$$ where $b_0$ is the average ratinG, $b_u$ and $b_i$ arE user And IteM bIaseS, resPectively. The esTImatIon of parameters is to minImize ThE RatiNG pRedicTion errOR iN THe tRaInIng DaTAsEt. The OptImizatiOn objectivE fuNcTion is $$\label{eQ:OjF}
    \begin{spliT}
        \vsPace{-2pt}
        \undersEt{p*,Q*}{\text{mIn}} \FraC{1}{2}\Sum_{u,i} (R_{u,i} & -\Hat{r}_{u,I})^2 + \frac{\mU_U}{2} ||\bm{p_u}||_2^2 + \fRac{\mu_i}{2} ||\bm{q_I}||_2^2 \\
        & + \mU_W \sum_a||\bM{W_a}||_1 + \frac{\mU_B}{2} (||B_u||_2^2 + ||B_i||_2^2);
        \vsPace{-2pt}
    \end{split}$$ wheRE $||\cDOt||_2$ denotes the $\elL_2$ norm fOr PReVENtiNg mOdel overfiTtIng, anD $||\Cdot||_1$ denOTeS THE $\elL_1$ Norm. $\mu_u, \mu_i, \mu_w$, And $\mu_b$ are reGUlaRizatiOn ParAMeters, Which ArE TunAble hyper-paRameTers. In praCtice, wE Relax thE Binary rEquireMenT of $\Bm{w_a}$ BY uSiNg $\eLl_L$ NorM. it Is wELl kNown that $\ElL_l$ RegulArizATION yieLds SparSe solUtion of the weiGhtS [@maiRAl2010oNline]. the $\elL_2$ regUlArizaTion of $\Bm{p_u}$ aNd $\Bm{q_i}$ prevents theM to hAve arbitrAriLy LarGe ValueS, Which wOulD leAd to arbItrarilY SmaLl VALUeS of $\bm{w_a}$.

**OptimizatioN.** WE USe The stochAstic gRAdIeNT descent (sGd) alGoriTHM to leArn tHE pArameterS by optIMiZiNg the obJeCtive fUnCtiOn iN Eq. \[eq:OJf\]. In Each stEp of SGD, tHe locALized optimizatIOn is performed ON a RATiNG $r_{u,i}$. let $l$ denote the lOss, aND the GradIEnTs oF ParamEters ArE GiVEn as follows: $$\begin{aliGnEd}
\labeL{eq:usEr}
    \small
    \vspace{-2Pt}
    
_i + b_0$$ where $b_0$ isthe averag e rat ing , $ b_ u$ a nd $ b_i$ are usera nd i tem biases, respective ly. T he esti m at ion o f param e te r s  is  t omin im i ze  therat ing pre diction er ror  i n the traini n gdataset. T heoptimization  ob jectiv efun c tionis$$\la bel{eq : ojf}
   \begin {s p lit}
      \ v s pa ce{- 2pt}
        \und e rs e t{p*,q*}{\text {min}}  \ f ra c { 1}{ 2}\ sum_{u,i}(r _{u,i }  & -\ha t {r } _ { u,i } )^2 + \frac{\ mu_u}{2} || \ bm{ p_u}|| _2 ^2+  \frac {\mu_ i} { 2}||\bm{q_i}| |_2^ 2 \\
       &+  \mu_w\ sum_a|| \bm{w_ a}| |_1  + \ f ra c{ \mu _b } {2} (| |b_ u ||_ 2^2 + || b_ i| |_2^2 );
   \ vsp ace{ -2pt} 
    \end{spl it} $$ w h ere  $||\ cdot| |_2$  d enote s the$\ell _2 $ norm for prev enti ng modelove rf itt in g, an d  $||\c dot ||_ 1$ deno tes the $\e ll _ 1 $  n orm. $\mu_u, \mu_i ,\ m u_ w$, and$\mu_b $  a re regulari za tio n pa r a meter s, w h ic h are tu nableh yp er -parame te rs. In  p rac tic e, we rela x thebinary r equir e ment of $\bm{w _ a}$ by using$ \e l l _l $  nor m.It is wellknow n  tha t $\ e ll _l$ regul ariza ti o ny ields sparse soluti on  of th e wei ghts [@mairal 2010online ] . The $\el l_2$ re g ularization of  $\bm {p_u}$ and $\bm{q_i }$ pr events t hem to ha v e  arbitra ril y l arg e v a l ue s, which woul d lead  t o arbit rar ily sma llval ues  of  $ \bm{w_a}$ .

**Opt im iz at io n.* * Weu se the s to cha st icgradi e nt des cent(SGD )al g ori thm tol ea r n  the  p ar amet ers  b y opt imiz i ngthe obj ective fu nct i on i nEq . \[eq: ojf\]. In eac hstep of SG D,  th e loca l i zed opti mization is performed o n  a rati ng$r_{u ,i}$ . Let $L$  de note t hel oss, a nd the  grad ie nts o f par a m et ers  a re given a s fol lows:  $ $\be gin{ali gned}
\label{eq:us e r}    \small
   \ vspa c e {- 2pt } 
  
_i +_b_0$$ where_$b_0$ is the average_rating, $b_u$_and_$b_i$ are_user_and item biases,_respectively. The estimation_of parameters is to_minimize the rating_prediction_error in the training dataset. The optimization objective function is $$\label{eq:ojf}
   _\begin{split}
_ ___   \vspace{-2pt}
 _    _ \underset{p*,q*}{\text{min}}_\frac{1}{2}\sum_{u,i} (r_{u,i} & -\hat{r}_{u,i})^2 + \frac{\mu_u}{2} ||\bm{p_u}||_2^2 +_\frac{\mu_i}{2}_||\bm{q_i}||_2^2 \\
 _      & + \mu_w_\sum_a||\bm{w_a}||_1 + \frac{\mu_b}{2} (||b_u||_2^2 + ||b_i||_2^2);
_  ___  \vspace{-2pt}
 _  \end{split}$$ where $||\cdot||_2$ denotes_the $\ell_2$ norm for preventing model_overfitting, and $||\cdot||_1$ denotes the $\ell_1$ norm._$\mu_u, \mu_i, \mu_w$, and $\mu_b$ are_regularization parameters, which are tunable_hyper-parameters. In_practice, we relax the binary_requirement of $\bm{w_a}$_by using_$\ell_l$ norm. It_is well known that $\ell_l$ regularization_yields sparse solution_of the weights [@mairal2010online]. The $\ell_2$ regularization_of_$\bm{p_u}$ and $\bm{q_i}$_prevents_them_to have_arbitrarily large values,_which_would lead_to_arbitrarily small values of $\bm{w_a}$.

**Optimization.** We_use_the stochastic gradient descent (SGD) algorithm to_learn the parameters by_optimizing_the objective function in_Eq. \[eq:ojf\]. In each step of_SGD, the localized optimization is performed_on a_rating $r_{u,i}$._Let $L$ denote the loss, and the gradients of parameters are_given as follows: $$\begin{aligned}
\label{eq:user}
  _ \small
  _ \vspace{-2pt}
__  