feed-forward neural networks linear unit the linear unit is simplest unit that transforms the input as as the name indicatesthe unit does not have non-linear behavior and is typically used to generate the mean of conditional gaussian distribution linear units make gradient-based learning fairly straightforward task (figure - figure - linear unit in neural network igmoid activation the sigmoid activation transforms the input as followsy wx the underlying activation function (figure - is given by ex