My webserver is constantly attacked by various IP addresses. They try five passwords and then change the IP address. 

I have done various lockdowns like using ssh-keys and not permitting passwords, and not allowing remote root login. 

Is there something I can do to get rid of these attack attempts? Failing that, are there specific defenses I should put up?