View with two filter groups using "OR" not aggregating correctly
The answer to this was actually quite simple, and the source of error was misunderstood.

The filter groups were NOT the issue at all, but rather that there were excluded fields in the view which were not set to "count" under their aggregation settings. This broke the count. If you are having this issue, make sure all fields in your aggregation view are set to "count".