Rush was the second son of William and Margery Rush née McGrath.
Rush then spent some months as a drover in southern New South Wales, while his brother John, taking advantage of the new Crown Lands Act took up a selection on the Lower Clarence River in 1863.