What is the appropriate statistical significance test for multi-class classification?
Generalisation of Mcnemars is called Cochran–Mantel–Haenszel test.
There is an implementation in R, but I suppose porting to Python should not be too hard. You can find the R version here.