As an agricultural settlement, Selca began its existence as a small part of the parish (the smallest administrative unit within the Christian Church) of Gornji Humac.
In 1943, shortly before the capitulation of Fascist Italy, the Italian army had burned large parts of Selca down, along with 6 other settlements on the Island of Brač, an event that left visible traces to this day.