Feed an American Goldfinch bird small seeds or broken nuts every 20 minutes. Do not force the bird to drink water. American Goldfinch are almost exclusively vegetarians. However, keeping and feeding baby birds is illegal in most parts of the United States. The best option is to return the baby to the wild.