The town was initially laid out by Robert Moffat about 25 km from the present location, in present-day Aberfeldy on the Elands River.
Harrismith was a major base during the South African (Anglo-Boer) War and visitors can see the several blockhouses, engineering works and a military cemetery that are evidence of this.