How to Import/Export Group field in Contacts via VCF?
You are doing this on the web inside of gmail, right?

I didn't see the groups included in the VCF file either.  But they do seem to be included if you export it as a CSV.  Is it possible that you can use the CSV instead?