text: Computing the y-representations. Finally to compute the prediction targets, the entire unmasked video clip is 
  processed by the y-encoder to obtain a set of target representations, denoted by sL = Eθ(xL) = (s1, . . . , sL). The 
  V-JEPA loss is now computed as 
  
  1 
  M 
  
  (cid:88) 
  Loss = 
  (2) 
  
  ˆsk 
  ∥ 
  k∈(i1,...,iM ) 
  sk  1, 
  −  ∥ 
  
  which is simply the average L1 distance between the output of the predictor and the y-encoder. We then compute a 
  gradient update with respect to the parameters of the x-encoder, θ, and the predictor, ϕ, and subsequently update 
  the parameters of the y-encoder as an exponential moving average of the context encoder weights (Polyak average). 
  
  16 