Is it possible to deselect a group while keeping the original selection selected?
Invert the selection with CtrlI
"Select" the group as you specify, with the Extend option enabled.
Reinvert the selection.


This works for many things, not just groups.