Annuity distributions are taxed as ordinary income, which is a higher rate than that for the capital gains you get from other retirement accounts. Annuities charge a hefty 10% early withdrawal fee is you take money out before age 59½.