BLD: since we already use setuptools, let's remove the optional logic…
… in setup.py (GH18113).

- [x] closes #18113 
- [x] tests added / passed
- [x] passes `git diff upstream/master -u -- "*.py" | flake8 --diff`
- [x] whatsnew entry
