Following Hoe's death at his house in Brunswick Square, London, a Mrs Brown from Lexington Kentucky, daughter of his manager, sued Hoe's estate for $250,000, claiming that he had promised her a large sum of money before he died.
On August 12, 1863 at Trinity Chapel, Wavertree near Liverpool, he married Olivia Phelps James (1837-1935), who was the daughter of Daniel and Elizabeth Woodbridge (Phelps) James [REF].