Present results of the best or the last iteration on dev set?
Is dev set a validation set here? Your best model occurred where the error on the validation set was lowest. That's the model you choose. However the validation error will be a slightly optimistic estimate of the true generalization error. Ideally you have held out a test set as well, and evaluate and report error on that.