text: Attacks against MoE. Mixture-of-Experts (MoE) architectures enable using multiple expert modules for processing a 
  given query with a lower computational cost by including an inner routing mechanism that in every layer routes different 
  tokens to a small number of experts [29, 30, 52, 56]. This can be thought of as an internal router within a single LLM, 
  rather than an external control plane that orchestrates multiple LLMs. MoE has increased in popularity as it allows to 
  build larger models at a fixed compute budget—not all parameters are used at the same time. 
  
  Hayes et al. [34] identified a vulnerability in MoE that can be exploited for a denial-of-service attack against MoE. Thus 
  control plane integrity issues appear to extend to the context of single-LLM MoE systems, and future work could explore 
  this connection further. 
  
  Yona et al. [67] presented a side-channel attack on MoE that enables an attacker to reveal other users’ prompts. We expect 
  that side-channel attacks against LLM control planes exist as well, for example, to infer which models are used via timing 
  of responses. Such attacks, which target confidentiality, are outside the scope of control plane integrity. 