How do you disable anonymous login?
I figured it out. While /etc/mysql/my.cnf didn't have a password keypair stored, there was a password stored in /root/.my.cnf. 

As soon as I commented out the password in /root/.my.cnf, I was not allowed to log in without a password (which is what I expected).