What's the advantage of log_softmax over softmax?
The short answer is yes, log_softmax + nll_loss will work better. 

I don’t know the implementation details under the hood in PyTorch, but see the screenshot below from the documentation: