sentence1: we train linear models using adagrad , a variant of sgd with adaptive adjustment to the learning rate of each parameter .
sentence2: we optimize these models using adagrad , with grid search to choose the base learning rate .