What is the intuition behind time being a physical dimension? I read the phrase "in cosmology terms, far away means long ago" somewhere and I got to thinking what if time is an emergent property of the interaction between matter and gravity. How can we think of time outside of space and matter? Or does it not need to be? 
Or am I just confusing matter and physical dimensions?