Add class to all labels in a comment form
Can't come up with a cleaner solution than implementing theme_form_element_label and adding the classes there depending on the elements name (comment_body) etc.

Maybe an option is to implement hook_form_comment_form_alter() and add specific identifiers to the elements you want to change the css class for the labels on in theme_form_element_label().