Why are non-required fields still showing up in my node_edit template using Page Manager
And I finally found out why:

If the user who's accessing this node_edit form variant has the right to update this field even if it's not required and you didn't add it to the form, it will show up as part of the base form in Node add/edit form (Home » Administration » Structure » Pages)

Hope that helps someone else too.