The municipality of Priboj is located between municipality of Čajetina in the north, municipality of Nova Varoš in the east, municipality of Prijepolje in the south-east, border with Montenegro in the south-west, and border with Bosnia and Herzegovina in the north-west.
The town of Priboj lies on the river Lim.