Native Americans left behind shell mounds on the island following their oyster feasts.
By the late 19th century, when the island's population reached about 275, a village had developed beside the Isle au Haut Thoroughfare separating Kimball Island.