OS X Yosemite Server won't create websites
Well, now I feel a bit silly. I was remotely administering the server using server.app on another computer within the local network. Everything worked straight away as soon as I tried the same process on the server itself using Screen Sharing.

I'm not sure why this is a problem, but it looks like remote administration using the Server.app doesn't work for everything!