Adding high p-value and low R square features in linear regression model to improve result
In general, adding more features will increase the quality of model fit.
If your goal is best fitting modeling, add as many features as possible (regardless of p-value).
Sometimes people care about parsimonious models, they are will to lower the overall model fit because they also value a simpler model. Then they apply a threshold to features using p-values.