MAINT: port numpy#13188 for np_datetime simplification
our _libs/tslibs/src/np_datetime.c is based off of the numpy version.  A recent PR there made a pretty nice simplfication to the relevant code.  We should do the same.

https://github.com/numpy/numpy/pull/13188/files