sentence1: training was implemented using mini-batch stochastic gradient descent with adagrad .
sentence2: the full model was trained using stochastic gradient descent combined with the adagrad algorithm regularization technique .