Effect of caffeine on infant: Maternal consumption of more than 300mg caffeine (about 3 cups brewed or filtered coffee) per day has been associated with jitteriness and irritability in the baby and also poor sleeping patterns. Maternal cigarette smoking accentuates the effects of caffeine in the breastfed infant.