Problem to view forms registration for anonymous user
you need to provide access to the guest user/visitor and you can find all the permission in WordPress Access Control 

CiviCRM » Administer CiviCRM » Access Control 

For more reference please give a read 
https://book.civicrm.org/user/current/initial-set-up/permissions-and-access-control/

I guess this helps !!!