Yeah, I'd be more for that. Also I'd just like better reasons for them to be kicked out beyond being unable to appreciate the MC for being amazing.

"Banished from the Hero’s Party, I Decided to Live a Quiet Life in the Countryside" got it right. Do something interesting with it!