Vrhpolje is a clustered village in the Upper Vipava Valley at the northwest foot of the Nanos Plateau. White Creek (), a tributary of the Vipava River, flows past the town to the east, but its bed is often dry because it is an influent stream. There are tilled fields in the low, flat areas toward Vipava, vineyards on the slopes to the north, and wooded land on the slopes of the Nanos Plateau to the east. There are karst caves in the vicinity.