Long stem influence on cyclocross handling
Couple of problems I can think of:

Reduced front-center (BB to front axle) on the smaller frame which means more toe overlap. 

For the same reason the front wheel will be tucked further under your center of mass, which may create problems on steep descents.