Make quiz link look like a button or apply css style
I just needed to apply custom CSS to a.quiz-start-link and .certificate-link respectively and then it worked.

I also learned about templates and this SE Post was helpful for creating a custom template for quizzes, so I could change the class that was being used like I originally wanted to: How to theme a quiz in D7?