Mansfield was born in Ruxley, Kent, the fifth of the seven sons of John Mansfield of Diggeswell House in Hertfordshire, and his wife, daughter of General Samuel Smith of Baltimore in the United States [REF].
In 1854, he married Margaret Fellowes, who became a noted suffragist and spiritualist after his death.