The site was set up in 1838 when the Monmouth Gas and Water Company was founded and the land leased for the site from the Duke of Beaufort at the foot of the May Hill between Monmouth Town and Wyesham near Monmouth Mayhill railway station .