What is the difference between the I2C interface and the "Grove" system?
The Grove System is a physical standardization of various electrical interfaces including but not limited to I2C, SPI, UART, GPIO, and analog connections. The Grove base shield is an Arduino 1.0 shield used to connect various peripherals to an Arduino-compatible mainboard.

Note that all Grove connectors are physically identical regardless of their purpose.