List field with 'Select All' option?
There are two workarounds that hit my mind, depending on the logic your UI could have.
1. If having no Group assigned could mean "assigned to all" - go for it.
2. Else: consider adding additional checkbox (boolean) field labeled "Fits all" (or whatever you like).