Why SVM gridsearch takes longer time?
Simple, optimization problem of SVM is of quadratic order. 
Just check first line of documentation


  "The fit time scales at least quadratically with the number of samples and may be impractical beyond tens of thousands of samples."