and our neural wiring just goes in a direction and that is the direction we see as time?
it's not quite a physical direction, although it can be represented by physical dimensions quite easily, especially if steady movement is occuring