Instrumentation or Differential amplifiers for milliohm measurement circuit design
The qualities of the amplifier that you look for are governed by what you expect of the product it's used in, and how you are going to use it.

It is a milli-ohmeter, so the source impedance is very low. You could have uA of bias current for all the difference that would make to your accuracy.

Offset voltage, initial. If you are going to zero it, this doesn't matter. If you want to build and forget, then it must be low enough to meet your accuracy expectations.

Offset voltage change with temperature. If you are going to zero it from time to time, this doesn't matter. If you want to zero it once, then use it summer or winter, then it must be low enough to meet your accuracy and environmental expectations.

Offset voltage drift with time. If you are going to zero it ... (I hope you're getting the general idea by now).

Noise. This is unlikely to be a dominant source of error, and you can always wait a little longer for the reading if it is. Thermal emfs at the contacts are likely to be a bigger problem, as they're DC so can't be averaged out like noise.

Don't forget to use those 4 leads in a 4-terminal configuration. If you connect the current source directly to the voltage sense and measure the resistor as a 2 terminal device, that will be your biggest source of error.