Mathematics: Can the result of a derivative for the Gradient Descent consist of only one value?
Gradient, g(x) = 0.4*x

At [x1 = 1], Gradient,
g(1) = 0.4
x2 = x1- step*gradient
=&gt;x2 = 1 - 0.1*0.4
=&gt;x2 = 0.96
At [x2 = 0.96], Gradient,
g(0.96) = 0.4*0.96 = 0.384
=&gt; x3 = 0.96 - 0.1*0.384 = 0.9216

Continue following the same steps and will reach near the minima.