Which way do I orient my bike tire's tread direction? and why?
The tires have more traction in some directions than in others.

Your front wheel does most of the braking; your rear wheel does all of the propulsion. 

Tires are oriented to give the most traction to the primary fore-and-aft forces.