Top 10 Doctor insights on: Is Vitex Or B6 Safe When Breastfeeding. 1 Is it safe to take vitamin B6 while pregnant or breastfeeding? Yes: Vitamin b6 is very safe, though there is evidence that doses over 200 mg can occasionally cause neuropathy. However, there is no good reason to take doses higher than 200 mg.