If a user or a visitor sees a port, they will try to stick something into it and then complain to us when it doesn't work or breaks their stuff. Are there such things as physical locks that can be put into ports so they can't use them?

Disabling a port is only half the solution/battle in our case.