He relocated to Brussels , then Jersey , and finally settled with his family on the channel island of Guernsey at Hauteville House , where he would live in exile until 1870 . He relocated to Brussels , then Jersey , and finally settled with his family at Hauteville House in Saint Peter Port , Guernsey , where he would live in exile until 1870 .