Where do I set that agent certificate for Puppet on Amazon Linux?
On the agent I needed to set the server ip set to puppet in 
/etc/hosts 

I had accidentally put it on the agents ip address and then been incorrectly assuming i'd done something wrong on the master rather than the agent.

(server ip)  (domian name)   puppet