Using a JFET as a voltage limiter
This same technique is used to pre-charge some offline controllers when its regulated voltage is not yet available. For example the depletion mosfet in the following diagram does exactly what you want, but only at start up. So, your approach should work alright if the load dependence does not play a significant role.



If you want to extend the voltage range that the JFET limits, you can add a voltage divider between source and gate as follows:



As already mentioned in the comments, another easier alternative would be to limit the voltage with a zener diode.