Comment notify options confusing for users
As discussed in the comments: no, you haven't got a configuration issue, and yes the module is working exactly as designed.

If your users are likely to find that confusing, you can use hook_form_alter() in a custom module/theme to change the text to something that makes more sense. Or even hide one or more of the options altogether, if that's what you need.