How do I implement softmax forward propagation and backpropagation to replace sigmoid in a neural network?
One of the best ways to learn is use reference of others.

Have a look at Peter Sadowski - Notes on Backpropagation (Page 3):



There is also a great blog post by Eli Bendersky - The Softmax Function and Its Derivative.