He was born in King's Lynn in 1781, son of John Kiallmark, an officer in the Swedish navy, and of Margaret Meggitt, a Yorkshire heiress, who lived in Wakefield and was related to Sir Joseph Banks.
Shortly after George's birth his father, who was in financial difficulty, abandoned the family and died soon afterwards.