Pension payments, annuities, and the interest or dividends from your savings and investments are not earnings for Social Security purposes. Only earned income, your wages, or net income from self-employment, is covered by Social Security. You may have to pay income tax on pensions, annuities, interest, or dividends, but you do not pay Social Security taxes. Those types of income are not on your Social Security record.