ENH: use correct dtype in groupby cython ops when it is known (without try/except)
Addresses part of #37494. And xref https://github.com/pandas-dev/pandas/pull/38162/files#r536191377

cc @jorisvandenbossche 