The Constitution states that Justices "shall hold their Offices during good Behaviour." This means that the Justices hold office as long as they choose and can only be removed from office by impeachment. ... The House of Representatives passed Articles of Impeachment against him; however, he was acquitted by the Senate.