The Monroes returned to Virginia in 1807.
The war went very badly, so Madison turned to Monroe for help, appointing him Secretary of War in September 1814 after the British had invaded the national capital and burned the White House.