How many epochs to run during hyperparameter search?
The general rule of thumb is to run the number of epochs until validation error starts to increase.
Sometimes fast initial learning will not lead to the best performance later.