Magnolia became known for its gardens after the Reverend John Grimke-Drayton inherited the property in the 1840s and developed them.
In the twentieth century, notable visitors have included George Gershwin, Henry Ford, Eleanor Roosevelt, Orson Welles and Reba McEntire.