Which one is more important in case of different loss optimization algorithms, Speed or the Route?
The route/trajectory followed by the optimization algorithm basically depends your dataset and the loss function. However, what really matters, for the purpose of final accuracy performance, is the final point which the trajectory converges to.