Set private key password for mysql using ssl
I had to make sure that mysql owned the .pem files by cd to directory that contains the .pem files and:

chown -R mysql .
chgrp -R mysql .


After doing that the problem was solved.