Solved desing problem with to_datetime when "ignore" error was being used.
- [x] closes #28120
- [x] tests added / passed `test_to_datetime_some_invalid_numbers`
- [x] passes `black pandas`
- [x] passes `git diff upstream/master -u -- "*.py" | flake8 --diff`
- [x] Now when u use some array of integers on to_datetime function passing as arguments: error="ignore" and format="%Y%m%d" it only skips none fitting values instead of all the values.
