In 1670, Ambrose White received a patent for called "an Island in the Chesapeake Bay".
The British used the island as a staging area during the War of 1812, when there were as many as 1,200 British troops recorded on the island at one time.