 From Liverpool, he made his way back to the Scottish Borders.Between 1835 and 1844 Ainslie was often in trouble with the law including for assaults and public nuisance.In 1841, court documents were prepared stating that Ainslie had "came home to see his son with the intention of returning to the Colony... but he has not yet found it convenient to return".