[137]
In the 1864 presidential election Fillmore supported the Democratic candidate, George B. McClellan, for the presidency since he believed that the Democratic Party's plan for immediate cessation of fighting and allowing the seceded states to return with slavery intact to be the best possibility for restoring the Union.[138]
After the Lincoln assassination in April 1865, black ink was thrown on Fillmore's house because it was not draped in mourning like others. Fillmore was apparently out of town at the time and put black drapes in the windows once he returned. Although he retained his position as Buffalo's leading citizen and was among those selected to escort the body when Lincoln's funeral train passed through Buffalo, anger remained towards him for his wartime positions.[139] Fillmore supported President Andrew Johnson's Reconstruction policies since he felt that the nation needed to be reconciled as quickly as possible.[140] Fillmore devoted most of his time to civic activities. He aided Buffalo in becoming the third American city to have a permanent art gallery, with the Buffalo Fine Arts Academy.[141]

Fillmore stayed in good health almost to the end of his life. 