How to correctly set output voltage with LT3080
It's normal for regulators to require a minimum load before they can take effect. From the datasheet, the minimum load current for your part is 0.5mA.  If you remove everything in your circuit after the LT3080, it won't regulate.