At the south end of the village lie the remains of Rothes Castle built on a hill by Peter de Pollok about 1200 to command traffic up and down this stretch of Strathspey.
Rothes was inhabited long before the castle was built; as far back as AD 600; missionaries had visited the area and built a chapel on Chapel Hill.