Public Cannot Access Contribution Pages
I see the "Make Online Contributions" permission.  I found it by going to:


Administer menu » Users and Permissions » Permissions (Access Control)
Select "WordPress Access Control".
Find "CiviContribute: make online contributions".  You'll probably want to check all the boxes next to it and press "Save".


See screenshots for all the steps above: