Badham was born at Ludlow, Shropshire, the fourth son of Charles Badham senior, a classical scholar and regius professor of physic at Glasgow; and Margaret Campbell, a cousin of Thomas Campbell, the poet.
From seven years of age, Badham was sent with his three brothers to Switzerland to study under Johann Pestalozzi.