A stone axe discovered in the town suggests that the area was already inhabited by the Neolithic period.
At the end of the 14th century and beginning of the 15th Kaltinėnai was one of 6-7 of the most important centres in Žemaitija.