feed-forward neural networks feed-forward neural networks were the earliest implementations within deep learning these networks are called feed-forward because the information within them moves only in one direction (forward)--that isfrom the input nodes (unitstowards the output units in this we will cover some key concepts around feed-forward neural networks that serve as foundation for various topics within deep learning we will start by looking at the structure of neural networkfollowed by how they are trained and used for making predictions we will also take brief look at the loss functions that should be used in different settingsthe activation functions used within neuronand the different types of optimizers that could be used for training finallywe will stitch together each of these smaller components into full-fledged feed-forward neural network with pytorch let' get started what is neural networkat an abstract levela neural network can be thought of as function (cnikhil ketkarjojo moolayil ketkar and moolayildeep learning with python