Then following the green graph we execute the LogDerivative operation  that the auto differentiation engine introduced, and multiply its result by  to obtain the gradient  as per the chain rule states. Next, the multiplication derivative is executed in the same way, and the desired derivatives  are finally obtained.