CLN: Revert "Return Python integers" (not needed after #20989)
This reverts commit 8e3d4d08501dc83d4c2302686c8342e7448c78e5.

- [x] tests passed
- [x] passes `git diff upstream/master -u -- "*.py" | flake8 --diff`

I had introduced the explicit casting to solve broken tests on Windows, but @jreback's #20989 is the correct way to do it, so these are now redundant.
