sentence1: we used the adagrad stochastic gradient update , a per-dimension learning rate method , to train the orbms and the irbms .
sentence2: we used the adagrad optimizer to train both models with mini-batch stochastic gradient descent .