From Puri Swami moved to hill caves of Khandagiri, Dhauligiri, Nilagiri etc. near Bhubaneswar (capital of Orissa state).
Later, Swami moved to Kakanpada village of Rairakhol with his first disciple Sidha Govinda Baba.