Although no U.S. regulation specifically addresses herbal tea, most of the herbs the FDA considers safe for food use are presumed safe for tea as well. This may or may not be the case. Teas made from herbs like peppermint and thyme may be safe to drink occasionally in small amounts while you're pregnant or nursing. But drinking excessive amounts of any tea can cause health problems for you and your developing baby.