Livesey was born on 5 March 1794 at Walton-le-Dale near Preston, Lancashire, the son of John Livesey, a cloth manufacturer, and Jennett (née Ainsley).
The family became weavers instead, practising their trade in a damp cellar, prone to flooding due to the nearby River Ribble.