1 Do not use aspirin for fever. 2  It can cause serious illness, especially if your child has chicken pox. 3  Your child may need a sponge bath if he has a fever over 104 degrees F (or 40 degrees C) and it has not gone down 30-60 minutes after getting medication. 4  Use lukewarm water, not cold water.