How do I make the priority menu disappear
I think you have to tap an empty space on the screen; if the screen is full of touch-sensitive stuff (homescreen) you can open Recents/Overview and swipe there, then close it again. Not ideal, but the best you can do.