 \right\rangle$, where $P$ denotes the interaction, and $O1$ and $O2$ denote its subject and object respectively. In our study, we assume the interaction context (*O1,O2*) has been detected by a detector (i.e. we are given bounding boxes and lables for both subject $O1$ and object $O2$) and the task we are addressing is to classify their interaction type $P$. To recognize the interaction, existing works take two extremes in designing the classifier. One is to directly build a classifier for each $P$ and assume that the same classifier applies to $P$ with different context. Another takes the combination of $\left\langle \emph{O1-P-O2} \right\rangle$ as a single class and build a classifier for each combination. As discussed in the introduction section, the former does not fully leverage the contextual information for interaction recognition while the latter suffers from the scalability and generalization issues. Our proposed method lies between those two extremes. Specifically, we still allocate one classifier for each interaction type, however we make the classifier parameters adaptive to the context of the interaction. In other words, the classifier is a function of the context. The schematic illustration of this idea is shown in Figure \[fig:overview\].

Formally, we assume that the interaction classifier takes a linear classifier form $y_p = \mathbf{w}_p^{\top}\phi(I),~~\mathbf{w}_p \in \mathbb{R}^d$, where $y_p$ is the classification score for the $p$-th interaction and $\phi(I)$ is the feature representation extracted from the input image. The classifier parameters for the $p$-th interaction $\mathbf{w}_p$ are a function of $(O1,O2)$, that is, the context of the $p$-th interaction. It is designed as the summation of the following two terms: $$\label{Eq:combine}
    \mathbf{w}_p(O1,O2) = \mathbf{\bar{w}}_p + r_p(O1,O2),$$ where the first term $\mathbf{\bar{w}}_p$ is independent of the context; it plays a role which is similar to the traditional context-independent interaction classifier. The second term $r_p(O1,O2)$ can be viewed as an auxiliary classifier generated from the information of context $(O1,O
\right\rangle$, where $ P$ denotes the interaction, and $ O1 $ and $ O2 $ denote its subject and object respectively. In our study, we wear the interaction context (* O1,O2 *) has been detect by a detector (i.e. we are given bounding box and lables for both capable $ O1 $ and object $ O2 $) and the task we are addressing is to classify their interaction character $ P$. To greet the interaction, existing oeuvre take two extremes in design the classifier. One is to directly build a classifier for each $ P$ and simulate that the like classifier applies to $ P$ with different context. Another bring the combination of $ \left\langle \emph{O1 - P - O2 } \right\rangle$ as a individual course and build a classifier for each combination. As discussed in the introduction department, the former does not fully leverage the contextual data for interaction recognition while the latter suffer from the scalability and generalization issues. Our proposed method lies between those two extreme. Specifically, we still allocate one classifier for each interaction type, however we make the classifier parameters adaptive to the context of the interaction. In other words, the classifier is a function of the context. The schematic illustration of this idea is shown in Figure \[fig: overview\ ]. 

 Formally, we assume that the interaction classifier takes a linear classifier form $ y_p = \mathbf{w}_p^{\top}\phi(I),~~\mathbf{w}_p \in \mathbb{R}^d$, where $ y_p$ is the classification score for the $ p$-th interaction and $ \phi(I)$ is the feature of speech theatrical performance extracted from the input image. The classifier argument for the $ p$-th interaction $ \mathbf{w}_p$ are a function of $ (O1,O2)$, that is, the context of the $ p$-th interaction. It is designed as the summation of the follow two terms: $ $ \label{Eq: combine } 
     \mathbf{w}_p(O1,O2) = \mathbf{\bar{w}}_p + r_p(O1,O2),$$ where the first term $ \mathbf{\bar{w}}_p$ is autonomous of the context; it plays a role which is similar to the traditional context - independent interaction classifier. The second term $ r_p(O1,O2)$ can be viewed as an auxiliary classifier generated from the information of context $ (O1,O
 \rihht\rangle$, where $P$ denoter the interaction, and $M1$ and $K2$ denote its subject and object respxcticely. Un our study, we assume the integaction cinteet (*O1,O2*) has been dxfected nv a dsbectox (m.e. we are given bounding toxes and lablas flr both subject $O1$ and object $O2$) and ehe tasl ae are addressyng ps to dlassify their interaction type $P$. Fo recojnize the intersction, existing works take two extremes in desigjing the clqssisuer. One is tu directly build a claasifier for each $P$ and assume tfat tke same clawsufift applies to $P$ winh different gpntext. Anothet takes the cokbiiatiin of $\left\langle \emph{M1-P-O2} \right\rangle$ as a single cmass and build a xlqssifher xor dqch cojbmnafion. Ad dmscussed in the introdyction section, the gowner does not rully jederage the contextual information for ittedaction recognition whioe the latter suffers from the scalability and generalization issues. Our proposad mevhud oics bdrwfen those two extremes. Specifically, we still wmlpcste one classinier for each intetaftojn type, howevgr we mcie the classifier pagameterf adaptive to uhe cpntext of the interaction. Ib other wordf, the classifier is a function of jhe comtext. The schematic illbstratjon of this idea is afown in Figure \[fkg:onervhew\].

Formally, we assume that the intecactipn clasrifigr takef a linear classifier form $y_p = \matjbf{w}_p^{\jop}\phi(H),~~\mathbf{w}_p \ln \mathbb{R}^d$, where $y_p$ is the classification scpra fmr the $p$-ch intcraction and $\phy(I)$ is the featore reprefentagion extrabted from the input ymage. The clavdifier paramxters for the $p$-th interazgion $\mathbf{w}_p$ sre a funbtnon of $(O1,O2)$, that is, the contewt of fhe $p$-th interaccnob. It is designec ar tre snmmatymn of the fonlowkng ywo tdrms: $$\label{Ew:zombone}
    \mathbf{w}_p(O1,O2) = \mdthbr{\bar{w}}_p + r_p(O1,O2),$$ where tme first jerm $\mathff{\bar{w}}_p$ is incependent of the clntexv; it puays s rjle which is similar to the trzditional coktext-independqnt lntetaction claxsifier. The second term $r_p(O1,O2)$ can be viexed as an auxiliary clawsifier generated ftom the informetion jf contexd $(O1,O
\right\rangle$, where $P$ denotes the interaction, and $O2$ its subject object respectively. In interaction (*O1,O2*) has been by a detector we are given bounding boxes and for both subject $O1$ and object $O2$) and the task we are addressing to classify their interaction type $P$. To recognize the interaction, existing works take extremes designing classifier. is to directly build a classifier for each $P$ and assume that the same classifier applies $P$ with different context. Another takes the combination $\left\langle \emph{O1-P-O2} \right\rangle$ as single class and build a for combination. As in introduction the former does fully leverage the contextual information for interaction recognition while the latter suffers from the scalability and generalization Our proposed between those extremes. we allocate one classifier interaction type, however we make the to the context of the interaction. In other the classifier a function of the context. The illustration of this idea is shown in Figure Formally, we assume that the interaction classifier takes a linear classifier form $y_p = \mathbf{w}_p^{\top}\phi(I),~~\mathbf{w}_p where $y_p$ is the score for the interaction $\phi(I)$ the representation extracted the input image. The classifier parameters for the $p$-th interaction $\mathbf{w}_p$ a function of $(O1,O2)$, that is, the context of the It designed as the of the following two $$\label{Eq:combine} = \mathbf{\bar{w}}_p + r_p(O1,O2),$$ first $\mathbf{\bar{w}}_p$ the it a role which is to the traditional context-independent interaction The second term $r_p(O1,O2)$ auxiliary classifier generated from the information of context
 \right\rangle$, where $P$ denotes tHe interactIon, anD $O1$ aNd $O2$ DeNote Its sUbject and objecT RespEctively. In our study, we asSume tHe INterACtIon coNtext (*O1,O2*) HAs BEEn dEtEcTed By A DeTectoR (i.e. We are giVen boundinG boXeS and lables foR BoTh subject $O1$ And Object $O2$) and thE taSk we arE aDdrESsing Is tO clasSify thEIr inteRaction tyPe $p$. to recoGNize the INTeRactIon, existing works tAKe TWo extremes in deSigninG tHE cLASsiFieR. One is to diReCtly bUIld a claSSiFIER foR Each $P$ and assumE that the samE ClaSsifieR aPplIEs to $P$ wIth diFfERenT context. AnoTher Takes the cOmbinaTIon of $\leFT\langle \Emph{O1-P-o2} \riGht\RangLE$ aS a SinGlE ClaSS aNd bUIld A classifIeR fOr eacH comBINATion. as dIscuSsed iN the introductIon SectIOn, tHe forMer doEs noT fUlly lEveragE the cOnTextual informatIon fOr interacTioN rEcoGnItion WHile thE laTteR sufferS from thE ScaLaBILItY and generalization IsSUEs. our propoSed metHOd LiES between ThOse Two eXTRemes. specIFiCally, we sTill alLOcAtE one claSsIfier fOr EacH inTeracTIon tYpe, howEver we maKe the CLassifier paramETers adaptive tO ThE COnTExt oF thE interactioN. In oTHer wOrds, THe ClaSSifieR is a fUnCTiON of the context. The schEmAtic ilLustrAtion of this idEa is shown iN fIGure \[fig:oVervIEw\].

fOrmally, we assumE that The interacTIon classIfier Takes a liNear classIFIer form $y_P = \maThbF{w}_p^{\Top}\PHI(I),~~\Mathbf{w}_p \in \matHBB{R}^d$, wHeRe $y_p$ is tHe cLassifiCatIon ScoRe fOr The $p$-th intEraction AnD $\pHi(i)$ iS thE featURe represEnTatIoN exTractED from tHe inpUt imAgE. THE clAssifieR PaRAMeteRs FoR the $P$-th InTeracTion $\MAthBf{w}_p$ are A function Of $(O1,o2)$, That Is, ThE contexT of the $p$-th inteRaCtion. It is dEsIgnEd as thE SUmmation Of the following two terms: $$\lABel{Eq:coMbiNe}
    \matHbf{w}_P(O1,O2) = \mathbf{\Bar{W}}_p + r_p(O1,O2),$$ WheRE the fiRst terM $\mathBf{\Bar{W}}_P$ Is indEPEnDenT oF the contexT; IT plAys a rOlE whiCh is simIlar to the traditionAL coNtext-independEnt InteRACtIon CLaSSifIeR. the SECond term $r_p(O1,O2)$ can Be viewed as An AUxIliary clasSIfiEr GeneratEd from tHe infORmation Of context $(o1,O
 \right\rangle$, where $P$  denotes t he in ter act io n, a nd $ O1$ and $O2$ d e note  its subject and objec t res pe c tive l y.  In o ur stud y ,w e  as su me  th ei nt eract ion  contex t (*O1,O2* ) h as  been detect e dby a detec tor  (i.e. we ar e g iven b ou ndi n g box esand l ablesf or bot h subject  $ O 1$ and object$ O 2$ ) an d the task we are ad d ressing is toclassi fy th e i r i nte raction ty pe  $P$. To reco g ni z e the interaction,existing wo r kstake t wo  ex t remesin de si g nin g the class ifie r. One is  to di r ectly b u ild a c lassif ier  fo r ea c h$P $ a nd ass u me  th a t t he samecl as sifie r ap p l i e s to  $P $ wi th di fferent conte xt.  Ano t her  take s the  com bi natio n of $ \left \l angle \emph{O1- P-O2 } \right\ ran gl e$as  a si n gle cl ass  an d build  a clas s ifi er f o reach combination.As d is cussed i n thei nt ro d uction s ec tio n, t h e  form er d o es  not ful ly lev e ra ge  the co nt extual  i nfo rma tionf or i nterac tion rec ognit i on while the l a tter suffersf ro m th e  sca lab ility and g ener a liza tion is sue s . Our  prop os e dm ethod lies betweenth ose tw o ext remes. Specif ically, we s t ill allo cate on e  classifier fo r eac h interact i on type,  howe ver we m ake the c l a ssifierpar ame ter s a d a pt ive to the co n t extof  the in ter action.  In  ot her  wo rd s, the cl assifier  i safu nct ion o f  the con te xt.  T heschem a tic il lustr atio nof thi s ideai ss h ownin  F igur e \ [f ig:ov ervi e w\] .

Form ally, weass u me t ha tthe int eraction clas si fier takes  a  li near c l a ssifierform $y_p = \mathbf{w}_ p ^{\top} \ph i(I), ~~\m athbf{w}_ p \ in \ma thb b {R}^d$ , wher e $y_ p$  is t he cl a s si fic at ion scoref o r t he $p $- th i nteract ion and $\phi(I)$i s t he feature re pre sent a t io n e x tr a cte df rom t he input image.  The class if i er  parameter s  fo rthe $p$ -th int eract i on $\ma thbf{w}_p $ are a f un ctio n of$(O1,O2)$,  that is , the con t ext o f  t he $p $-t h inte ra cti on. I t is d e sig ned a s thesu mmatio n ofth e follow ing two terms: $$\label {Eq:co mbine }
   \mathb f{w } _p( O1,O2) =\mat hbf{\bar{w }}_ p +  r_p( O1, O 2),$$  whe r ethe first  ter m  $\mathbf { \b ar{ w } }_ p$ is indep e n d ent  of t hec ontext ; it  plays a role whi c h is similar t o th e tra dit i onal  c ontext-indepen den ti n teractio nclassifier.  The sec on d  term  $r_p( O1,O2) $ can b e vi e wed as  anaux iliary cl ass if i er gene ra te d  fromthein format ion of cont e x t $(O1,O
 \right\rangle$,_where $P$_denotes the interaction, and_$O1$ and_$O2$_denote its_subject_and object respectively._In our study,_we assume the interaction_context (*O1,O2*) has_been_detected by a detector (i.e. we are given bounding boxes and lables for both_subject_$O1$ and_object_$O2$)_and the task we are_addressing is to classify their_interaction type_$P$. To recognize the interaction, existing works take_two_extremes in designing_the classifier. One is to directly build a classifier_for each $P$ and assume that_the same classifier_applies_to_$P$ with different context._Another takes the combination of $\left\langle_\emph{O1-P-O2} \right\rangle$ as a single class_and build a classifier for each combination._As discussed in the introduction section,_the former does not fully_leverage the_contextual information for interaction recognition_while the latter_suffers from_the scalability and_generalization issues. Our proposed method lies_between those two_extremes. Specifically, we still allocate one_classifier_for each interaction_type,_however_we make_the classifier parameters_adaptive_to the_context_of the interaction. In other words,_the_classifier is a function of the context._The schematic illustration of_this_idea is shown in_Figure \[fig:overview\].

Formally, we assume that_the interaction classifier takes a linear_classifier form_$y_p =_\mathbf{w}_p^{\top}\phi(I),~~\mathbf{w}_p \in \mathbb{R}^d$, where $y_p$ is the classification score for the_$p$-th interaction and $\phi(I)$ is the_feature representation extracted from_the input_image._The classifier parameters_for_the $p$-th_interaction $\mathbf{w}_p$ are a function of $(O1,O2)$,_that is,_the context of the $p$-th interaction._It is designed as_the_summation of the following two terms:_$$\label{Eq:combine}
    \mathbf{w}_p(O1,O2) =_\mathbf{\bar{w}}_p + r_p(O1,O2),$$ where the_first_term_$\mathbf{\bar{w}}_p$ is independent of the_context; it plays a role which_is similar to_the traditional context-independent interaction classifier. The second_term_$r_p(O1,O2)$ can be viewed as an_auxiliary_classifier generated from the information of_context_$(O1,O