Anonymous users skip comment approval but they shouldn't
On my side, the problem was the use of the cleantalk module.

In this module, in the configuration page: admin/config/content/cleantalk/settings

You must uncheck "Enable automoderation" if you do not want to override the "Skip comment approval" permission