Neural Network unable to track training data
Ok I have found out atleast one thing why it's happening that way after asking my friends,

We can't use sigmoid as the last layer since it will always output something between 0 and 1 and hence that's why your predictions are not varying at all...
i.e we can't at all use sigmoid as the last layer until it's a classification of let's say images and all...