The township was named after the Chiltern Hills in England . It was surveyed in 1853 but not started until gold was found in 1858 â '' 59 during the great Victorian Gold Rush period . The township , named after the Chiltern Hills in England , was surveyed in 1853 but not established until gold discoveries in 1858-59 during the greater Victorian Gold Rush period .