How do I remove the information section available below the comment box?
Simplify module is what you are looking for. Besides hiding the text format selection, it has a few more settings to hide, which really "simplifies" the user interface.


  Simplify allows particular fields to be hidden from the user interface. This helps to de-clutter forms and present a more user-friendly experience to content editors.