The brothers were born in Hanamkonda into a Niyogi Telugu Brahmin family of four brothers and some sisters, among whom, according to a Dutch contemporary source, Akkanna was his mother's favourite. Madanna was, however, the more talented. There has been some discussion in the historical literature about the question whether they were Telugu or Maratha Brahmins. It is probable that they were Smarta Brahmins, who honoured both Shiva or Vishnu, along with Surya. They were Niyogis and also uncles of Bhakta Ramdas. Akkanna's descendants were called Akkarajus and Madanna's descendanants were Madarajus. Originally they had the surname of Pingili.