Axial precession is similar to the precession of a spinning top.
This average torque is perpendicular to the direction in which the rotation axis is tilted away from the ecliptic pole, so that it does not change the axial tilt itself.