Mere presence of SD card causes all sort of issues - what can be wrong?
tl;dr: Have you tried with another SD card already? Have you tried the SD card on another phone? Try formatting the SD card and resetting the phone.

Maybe there is some problem with a file on the SD card, that isn't recognized by your computer, but that your phone doesn't like. Maybe you could try to format your SD card, so that everything is removed (also the possibly bad file). Or check if you have the same problem on your phone with another SD card.

Could be that this doesn't fix your problem, then I would suggest you try to reset your phone (don't forget to take a backup of course). And see if you still have the problem.

If this (formatting SD + resetting phone) also doesn't help, then I am out of ideas. Maybe then there is something wrong with your hardware, but I hope one of the above will fix the problem.