text: # For reward condition left 
  A[1][:,:,2] = [ 1 .0 
  0 .0 
  0 .0 
  0 .0  0 .0 
  1 .0 
  0 .0 
  0 .0  0 .0 
  0 .0 
  1 .0 
  0 .0  0 .0 
  0 .0 
  0 .0 
  1 .0 ] 
  (cid:6)  (cid:5) 
  
  The second modality was the reward modality, which mapped the observations “no re- 
  ward”, “reward” and “loss” onto the location states and reward conditions. For the second 
  modality, we therefore had a tensor that was three reward observations by four location 
  states by two reward conditions, i.e., a 3 × 4 × 2 tensor. When the agent was at the centre 
  and cue locations, we let the modality accurately expect the observation of “no reward” 
  with certainty. For the two arm locations, we let the agent be agnostic regarding whether 
  they provided rewards or losses. This was different from the true reward probabilities 
  (see Figure 3), which the agent needed to learn over time. This was the case for both 
  reward conditions. 