Almond milk is low in both fat and protein content, and a toddler who is drinking almond milk will need to consume plenty of fat and protein in their diet from other sources. Babies may have an allergic reaction to nut milks, so always talk to a doctor before adding almond milk to the diet.