How hot should things be getting when I measure them with an ammeter?
If you're using an ammeter across a battery then you are essentially shorting it and it will get very hot, and possibly cause damage. Don't do this!