Even a relatively small asteroid, coming in at the right angle... not necessarily hitting Earth, but sort of grazing the earth... could, theoretically, change the tilt axis of the earth significantly.