Ejecting SD card takes a long time and CPU usage goes up
You can also try disabling Spotlight indexing for the SD card. While the card is inserted go to System Preferences->Spotlight->Privacy->'+' and add the drive.