sentence1: to optimize model parameters , we use the adagrad algorithm of duchi et al with l2 regularization .
sentence2: to minimize the objective , we use stochastic gradient descent with the diagonal variant of adagrad .