Synchronize Gmail but not contacts
When you tap Google in your accounts list, the first option shows your user mail. Tap that and you will see a list of services which are getting synced. Untick Contacts and make sure Gmail is checked.