The coastal area of the Milton-Ulladulla district was observed by Captain James Cook in 1770 when sailing along the east coast of Australia, before landing at Botany Bay.
Former convict, Henry Claydon took possession of 100 acres of land near Milton in 1855, establishing an estate known as Claydon Park.