What happens when you have highly correlated columns in a dataset?
Having highly correlated features is a type of redundancy in features. And yes, it effects a regression model if you are having highly correlated features. A very nice explanation is given here. 

PCA is a nice choice when it comes to dimensionality reduction.