The issue of updating a formula.
@liuanan,
The PR raised for the mentioned issue has been assigned for reviewing and once it is merged this issue will move to closed status. Thank you! @liuanan,
As this issue is related to Keras,  the Keras repository code which you were suggested has the correct formula. Could you please take a look at this Adam file.
https://github.com/keras-team/keras/blob/cdffff886626e5a05bc5d54b8a4634f1e5db06cf/keras/optimizers/legacy/adam.py#L468

```
        m.assign_add((grad - m) * (1 - coefficients["beta_1_t"]))
        v.assign_add((tf.square(grad) - v) * (1 - coefficients["beta_2_t"]))
        if self.amsgrad:
            vhat = self.get_slot(var, "vhat")
            vhat.assign(tf.maximum(vhat, v))
            v = vhat
        var.assign_sub((m * alpha) / (tf.sqrt(v) + coefficients["epsilon"]))
``` In this case, there's nothing TF needs to do This issue is stale because it has been open for 7 days with no activity. It will be closed if no further activity occurs. Thank you. This issue was closed because it has been inactive for 7 days since being marked as stale. Please reopen if you'd like to work on this further. Are you satisfied with the resolution of your issue?
<a href="https://docs.google.com/forms/d/e/1FAIpQLSfaP12TRhd9xSxjXZjcZFNXPGk4kc1-qMdv3gc6bEP90vY1ew/viewform?entry.85265664=Yes&entry.2137816233=https://github.com/tensorflow/tensorflow/issues/61407">Yes</a>
<a href="https://docs.google.com/forms/d/e/1FAIpQLSfaP12TRhd9xSxjXZjcZFNXPGk4kc1-qMdv3gc6bEP90vY1ew/viewform?entry.85265664=No&entry.2137816233=https://github.com/tensorflow/tensorflow/issues/61407">No</a>

https://github.com/tensorflow/tensorflow/blame/d5422e3857a3bcab5063fdd01600d4c15393c887/tensorflow/python/keras/optimizer_v2/adam.py#L443

var.assign_sub(
        (m * alpha) / (math_ops.sqrt(v) - coefficients['epsilon']))
should be：
var.assign_sub(
        (m * alpha) / (math_ops.sqrt(v) + coefficients['epsilon']))