Disable password authentication on SSH server on OS X Server 10.8
As any BSD system you should toggle off some options in your sshd_config like I've described in this Stack Overflow answer:

UsePam yes # it will not be used
ChallengeResponseAuthentication no
PasswordAuthentication no
kbdInteractiveAuthentication no