How exactly does SGD with momentum works in keras
I noticed the same issue. Also, it seems that the equation for applying momentum does not exactly match up with the standard one:

$$ v_{d\theta} := \beta v_{d\theta} + (1 - \beta)d\theta \\
 \theta := \theta - \alpha v_{d\theta}$$