How to start SQL Developer with the correct Java Version?
As @ruffin pointed out in the comment above I had to edit the package itself! It includes a sqldeveloper.sh script that changes my currently set JAVA_HOME. Just had to comment it out!