It has a higher-than-average cost of living, according to Smartasset.com, it is not a particularly least tax-friendly state for retirees. Oregon exempts Social Security retirement benefits from the state income tax but taxes income from retirement accounts such a 401(k) or an IRA at the full state income tax rates.