From 1381 to 1806 the village belonged to the territory of Niederhohenberg (Lower Hohenberg) of the County of Hohenberg.
When in 1807 the Oberamt Rottenburg (Oberamt of Württemberg) was founded, Schwalldorf became a part of it.