Characterizing raw op amp gain
You are trying to use the "opamp out of the range it behaves well". Used open loop like this it becomes a makeshift comparator.  

Opamps are meant to always be used closed loop. The open loop gain is pretty variable so cannot be relied upon, the only real requirement is that it's as large as possible (ideally infinite) When you close the loop though the huge gain makes the (closed loop) gain very accurate and the open loop variability (usually) makes almost no difference.  

In theory, with an ideal opamp what you are trying would work okay, but in real opamps you have slight mismatches, causing things like input offset voltage which just by itself will cause this experiment to fail.  

If we look at page 3 of the datasheet, we see the typical offset voltage for the LM324 is 2mV, up to a maximum of 7mV (3mV for the LM324A). This swamps your tiny input signal, and will cause the output to do just about anything, probably saturate.
There is also an offset current, external noise, and other non-ideal parameters that are variable with temperature that will cause issues here.
For an example of how variable the open loop gain is, here is a graph of the open loop gain over supply voltage:



We can see at 5V, the open loop gain is around 100dB (100,000) compared to 120dB (1,000,000) at 15V. This is a factor of 10 difference. Also we can see it varies considerably with load.