What issue is there, when training this network with gradient descent?
what issue arises, when trying to train this network with gradient descent?

The activation function is sign function or signum function (A little modified).
So, its Derivative will be 0 at all the points
 Hence, the Gradient descent won’t be able to make progress in updating the weights and backpropagation will fail.