Backport PR #33089 on branch 1.0.x (BUG: Don't cast nullable Boolean to float in groupby)
xref #33089

regression in 1.0.0, xref https://github.com/pandas-dev/pandas/issues/32194#issuecomment-604664466

# NOTE: same code fix, different location

cc @dsaxton 