Why can Search results not be removed from mailing recipients?
I suspect this was an intended outcome ie, you do a search, you find your contacts, you use "Email - send/schedule via civimail" and that locks in the recipients.

If at that point you decide your search was incorrect, then you need to start over.