API: to_datetime, required unit with numerical (#15836)
* add test_to_datetime_numerical_input
* check arg for numerical type

 - [x] closes #15836 
 - [x] tests added / passed
 - [x] passes ``git diff upstream/master --name-only -- '*.py' | flake8 --diff``
 - [x] whatsnew entry
