ElasticNet Convergence odd behavior
Increasing tolerance will result in &quot;higher root mean squared error value&quot; most of the time. Increasing tolerance is telling the model it is okay to stop earlier with higher error and not continue the search for a possible more optimal solution using smaller updates.