LM317 adjustable constant current source - Why is the voltage between Output and Adj pins is not always 1.25V?
Yes, to keep it in regulation, there must be a minimum current draw from the regulator output. In general this is in 5-10 mA range but feel free to read the datasheet of the specific component you have.