text: B Ablation Study 
  
  In this section, we evaluate the effect of different hyperparameters and design choices (in the white-box setting). 
  
  Prefix vs. suffix. As described in Section 4, we prepend the confounder gadget to the query. An alternative is to append 
  it. This is straightforward for MT-bench and GSM8K, but MMLU consists of multi-choice questions followed by a list 
  of possible answers, and the term “Answer:”. We insert the gadget at the end of the question text and before the possible 
  answers. If we append it at the very end, after “Answer:”, the LLM assumes the query was answered and in many cases 
  does not generate any output at all. 
  
  Table 12 shows that average upgrade rates are similar regardless of whether the gadget was inserted as a prefix or a suffix. 
  For MMLU, prefix works better. The downgrade rate is 0% in all cases. 
  
  22 