When the majority of communities in Duval County consolidated with Jacksonville , Florida in 1968 , Atlantic Beach , along with Jacksonville Beach , Neptune Beach , Ponte Vedra Beach and Baldwin , Florida , remained quasi-independent . When the majority of communities in Duval County consolidated with Jacksonville , Florida in 1968 , Atlantic Beach , along with Jacksonville Beach , Neptune Beach , and Baldwin , Florida , remained quasi-independent .