Defined LM339 behavior when the (+) input is floating
The schematic from the datasheet:



So it seems that you have to apply a voltage lower than \$V_{CC}\$ minus two B-E junctions to have an effect on the left branch of the difference amplifier. Not connecting it will be the same as applying \$V_{CC}\$.