A. Withdrawals from IRAs are taxable income and Social Security benefits can be taxable. ... If you never made any nondeductible contributions to any of your IRA accounts, all of the IRA withdrawal is counted as taxable income.