Secure ADB connection over network
What I ended up doing was starting another ssh server in the android environment using another port, from which I then can stop and start the adb daemon. Not nice, but it gets the job done.