He died in Tompkinsville on June 11, 1825, 99 days after leaving office, and was interred in the Minthorne vault in the west yard of St. Mark's Church in-the-Bowery, New York City.
Tompkins was the second vice president to serve two terms full terms, after John Adams, who was George Washington's vice president from 1789 to 1797.