Pass argument to view block within a minipanel
I just solved the exact same thing on my site, so writing it up here for future reference. 

Your views: 


Create these as content panes
Contextual filter = Content: thas taxonomy term id (in this case)
Argument input (under "Pane settings" in the view) = "Input on pane config"


Your mini panels


Context -> Required context: taxonomy terms
Content -> (Your views) -> Settings -> "Term id" (probably named differently) = %taxonomy_term:tid


Your main panel


Context: Add taxo term id. You will have to add each term id you will want to use as a context here. 
Content -> (Your mini panels) -> Settings, select the term you would like to use on that instance of the mini panel: