In March 1872, Barnard was impeached by the New York State Assembly.
Barnard died from Bright's disease at his residence, 23 West Twenty-Third Street, in New York City, and was buried at Green-Wood Cemetery.