Stochastic gradient descent with a batch size of 1 is apparently used to learn from single examples as they arrive, but I don't understand why you would use such a small batch size instead of batching training inputs together.
What are the advantages of online learning when training neural networks?
machine learning;neural networks