Apple maps view route duration without traffic
There's no way to schedule a drive or to view routes without traffic at the moment in Apple Maps. 
The Traffic button just displays the traffic on the map, it doesn't affect the routes. 

The only thing you can do is use another app (like GMaps or Waze) and send feedback to Apple (Report an issue > Other Issue).