How to remove obsolete contact groups?
For account groups, you need to remove or disable in the preferences. In the "Contacts" app, go to the menu bar, "Contacts" then "Accounts..." those accounts should be listed. If so, you can remove or turn them off (uncheck the "Enable this account" box) there.