How can I make compiled applescripts on $PATH be found and executed?
Since .scpt are not executable you won't be able to do this. 

The shebang (!#) is not in the AppleScript syntax and therefore it won't do anything.