Curve Modifier Gives Unexpected Effects
The tilt of individual (or all) points on a curve can be adjusted by highlighting the relevant control points and pressing Ctrl+T followed by making the adjustment.

When you are using another object with a curve modifier this will adjust the orientation of that object as it follows the curve.