Ladysmith is located on the banks of the Klip River (stone river), with the central business district and a large part of the residential areas located within the flood basin of the river. It is on the foothills of the Drakensberg mountains, about 26 km from the Van Reenen's Pass.