BUG: downcast = 'unsigend' on 0 would would not downcast to unsigned.
Continuation of #14412
- [ ] closes #14401
- [ ] tests added / passed
- [ ] passes `git diff upstream/master | flake8 --diff`
- [ ] whatsnew entry

Once again I had some very bizarre issues with git. Hope this does it this time.
