Command in $PATH not found
To analyze problems like that it helps to 


check whether the target of the symlink exists (ls -l ~/Applications/calibre.app/Contents/MacOS/ebook-convert)
check whether the target is executable
verify whether the shell sees the file in question (type ebook-convert)


Doing so made me realize that Calibre was installed in /Applications instead of ~/Applications.