Gerry was Vice President under James Madison and died in office on November 23 , 1814 . Elbridge Thomas Gerry ( ; July 17 , 1744 â `` November 23 , 1814 ) was an American statesman and diplomat . As a Democratic-Republican he was selected as the fifth Vice President of the United States ( 1813-1814 ) , serving under James Madison , until his death a year and a half into his term .