While training as a teacher, O'Reilly joined the Sydney University Regiment, a unit of the Militia Forces (Army Reserve).
During a vacation, O'Reilly caught the train from Sydney back to Wingello, which stopped at Bowral mid-journey.