Can a Table Column be Rich Text / WYSIWYG? The only types in the list are Single-line text, Multi-line text, Number or Checkbox.
I think that's actually a table field type you are referring to, not a Matrix Field Type.

Matrix field types can indeed have Rich Text. There are a lot of instances where a Matrix field can be used in place of a table field.