title: Can you use multiple output layers in a neural network without using softmax?
body: <p>I'm working on implementing a neural network for a class project and I was just wondering if it is possible to do multiclass classification with a neural network without using softmax? When I asked the TA about this he said that having multiple output layers isn't mathematically sound, but then I saw that Andrew Ng included a picture of a neural network with multiple outputs in his UFLDL tutorial on autoencoders, and then I see a lot of people talking about multiclass classification with neural networks without mentioning softmax. So I guess what I would like to know is whether it is appropriate to use multiple output layers without using softmax, and if so how would you do it and how would you interpret the results. </p>
  
  <p>UFLDL link: <a href="http://ufldl.stanford.edu/wiki/index.php/UFLDL_Tutorial" rel="nofollow noreferrer">http://ufldl.stanford.edu/wiki/index.php/UFLDL_Tutorial</a></p>