Is there a way to set an order to the way files are available in Azure? I want the latest backup first
You can't change how the files are stored in Azure but I guess you don't want to, you just want so change the sort order of the view in the Azure portal?

In that case I recommend using Microsoft Azure Storage Explorer instead.