 Haliburton was formally deprived of his bishopric on 22 July 1689.Haliburton moved to Newtyle parish in Angus, assisting the work of an episcopal minister there until the Church of Scotland forcibly took over control of it in 1698.He then retired to his own residence at nearby Halton, and received a pension in the following year.