He was the sixth son of Charles Towneley of Towneley Hall, Lancashire, by his wife Usula, daughter of Phillip Fermor of Tusmore, Oxfordshire.
Towneley went to France in 1728, where Jacobite sympathisers found him a commission in the royal service.