0 Example Attack Scenario An attacker exploits a vulnerability in a company's infrastructure to gain unauthorized access to their LLM model repository.  The attacker proceeds to exfiltrate valuable LLM models and uses them to launch a competing language processing service or extract sensitive information, causing significant financial harm to the original company A disgruntled employee leaks model or related artifacts.  The public exposure of this scenario increases knowledge to attackers for gray box adversarial attacks or alternatively directly steal the available property An attacker queries the API with carefully selected inputs and collects sufficient number of outputs to create a shadow model A security control failure is present within the supply-chain and leads to data leaks of proprietary model information A malicious attacker bypasses input filtering techniques and preambles of the LLM to perform a side-channel attack and retrieve model information to a remote controlled resource under their control.  Reference Links Meta's powerful AI language model has leaked online: https://www. theverge