He replaced Secretary Paul O'Neill on February 3 , 2003 and was succeeded by Henry Paulson on July 3 , 2006 , in a move that had been anticipated for several weeks . He replaced Secretary Paul O'Neill on February 3 , 2003 and was succeeded by Henry Paulson on July 3 , 2006 , in a move that had been anticipated .