DOC: Add details to DataFrame groupby transform
- [X] closes #13543
- [X] tests added / passed
- [X] passes `git diff upstream/master | flake8 --diff`
- [ ] whatsnew entry

Add requirements for user function in groupby transform

closes #13543
[skip ci]
