The school is located on in an area of Fredericksburg bounded by George, Kenmore, William and Barton streets.
In 1937, the school was enlarged with the addition of James Monroe Elementary School, a separate building connected by a covered walk, and the name was changed to James Monroe High School.