Where in the database is the Date Added for Group records?
That information is contained in the table civicrm_subscription_history

To remove them from those regular groups you would need to remove them from both the civicrm_subscription_history table and the civicrm_group_contact table

Seamus