TST: Move datetime specific test from common tests
This test gets rerun multiple times unnecessarily since it is included in the common tests but is actually datetime specific.  Moved it to the more appropriate `datetimes/test_datetime.py` file. Did a quick audit of the other common tests and the rest look fine.