for playing exceptionally high stakes; one often repeated story concerns his loss, on his 21st birthday in 1779, of over £100,000 in a single game of hazard to a Mr O'Byrne. O'Byrne, recognising that such a sum would bankrupt his opponent, refused to take more than £10,000, insisting that they roll the dice again to determine the fate of the remaining £90,000. Harvey won and kept his fortune, but reportedly still failed to pay the £10,000. Despite this riotous lifestyle, Harvey married Lady Louisa Nugent in 1784. Louisa was a daughter of Robert Nugent, 1st Earl Nugent and co-heir to his substantial wealth. The couple had nine children, eight of whom survived infancy and six of whom, all daughters, outlived their father. Harvey's eldest son was killed in action serving in the British Army under the Marquess of Wellington at the siege of Burgos in 1812. Harvey remained in semi-retirement until 1790, dividing his time between London and Rolls Park. Return to service In 1790, Harvey was recalled up to the Navy during the Spanish armament and commanded the frigate HMS Hussar for six months, until the Navy returned to its peacetime complement. Three years later, Harvey was once again recalled to the Navy with the outbreak of the French Revolutionary Wars. Harvey would remain in service for the next 16 years, only briefly taking leave in 1802 during the Peace of Amiens. In 1793, Harvey became captain of the frigate HMS Santa Margarita in the West Indies. There he participated in the successful campaigns against the French colonies of Guadeloupe and Martinique under Admiral John Jervis. In May 1794 Harvey returned to Britain and served in the squadron under Sir John Borlase Warren which raided the French coast with great success in 1794 and 1795. In August 1795, Harvey took command of the ship of the line HMS Valiant, initially in the Channel Fleet and later in the West Indies under Sir Hyde Parker. In 1797 Harvey returned to Britain due to ill-health, and was given command of the Essex sea fencibles during the next year. In 1800 Harvey returned to sea in command of HMS Triumph, which he retained until the Peace of Amiens. During the peace he again dabbled in politics, becoming MP for Essex in 1802. Even after returning to the Navy in 1803 as captain of the second rate HMS Temeraire, Harvey remained in parliament,