What are the known ways to test AI black boxes?
On the applicability of Artificial Intelligence in Black Box Testing (Khanna, 2017) might be a good place to start. It classifies some black box testing techniques based on the AI branch it belongs to.