 As a center of agricultural mercantilism, throughout most of the late 18th and 19th century, Jefferson was also home to a sizable population of slaves.The Hagerstown and Frederick Railway linked Jefferson to Frederick and Hagerstown in 1907.However, Maryland Route 180 remained the only link to the closest steam powered rail station in Brunswick.