BUG: rank treating min int as NaN
- [x] closes #32859
- [x] tests added / passed
- [x] Ensure all linting tests pass, see [here](https://pandas.pydata.org/pandas-docs/dev/development/contributing.html#code-standards) for how to run them
- [x] whatsnew entry

ASV's look unaffected:
<details>

```
before           after         ratio
     [029907c9]       [b45f9193]
     <master>         <bug/rank_datetimelike>
       6.90±0.2ms       6.76±0.6ms     0.98  frame_methods.Rank.time_rank('float')
       2.63±0.3ms       2.39±0.2ms    ~0.91  frame_methods.Rank.time_rank('int')
         45.7±1ms         45.3±1ms     0.99  frame_methods.Rank.time_rank('object')
       2.47±0.2ms       2.22±0.1ms    ~0.90  frame_methods.Rank.time_rank('uint')
      10.8±0.09ms       10.8±0.8ms     1.01  series_methods.Rank.time_rank('float')
       8.10±0.2ms       8.26±0.3ms     1.02  series_methods.Rank.time_rank('int')
         51.3±2ms         51.2±1ms     1.00  series_methods.Rank.time_rank('object')
       8.76±0.6ms       8.30±0.2ms     0.95  series_methods.Rank.time_rank('uint')
```

</details>