Is there a way to remove everything in my Android phone Contacts and then transfer everything in Gmail contacts into the phone contacts? I make extensive use of GROUPS in my Gmail account.  For example, all medical contacts are stored in MEDICAL, restaurants in RESTAURANTS, etc.  When doing this I specifically do not have the group entry appear in MY CONTACTS.  This removes clutter from MY CONTACTS.  I have 97 entries in MY CONTACTS, and 300 entries among the groups that do not appear in MY CONTACTS.  Somewhere I COPIED my Gmail to my phone contacts and to my surprise all the group entries from Gmail now also appear in MY CONTACTS on the phone which results in 397 phone contacts (97 + 300).  I would like the phone contacts to be exactly as they appear in the Gmail contacts.  

I have tried Settings > More > Applications > Go right to all apps > scroll down to "Contacts Storage" Then clicked on contacts storage > Click Clear Data but that did not do the job.
If you only want a particular contact group to appear in the contacts app on your phone, then you can achieve it pretty easily by using the Contacts to display option in your Contacts app.


Open Contacts app. 
Tap on the 3 dots at top right, choose Settings. 
Select Contacts to display > customize. 
Expand your Google account and uncheck all the other groups and keep only My Contacts.




Do note that when performing a search within contacts, it will still search within all the available contacts. But under normal display it will only show your 97 contacts stored under My Contacts group.