Goats love apple, but if fed a whole bucket of them in one sitting, you risk them fermenting in the digestive system and causing bloat, just like overfeeding grain will do. In order to harm a goat they would have to eat 5 pounds of apple seed.