His grandfather Akbar Ali was the jagirdar of Kotaha (Kutaya), usually spoken of as the Mir of Kotaha, and enjoyed also a perpetual pension of Rs. 400 a year, granted in 1850, in return for the surrender of the right to levy transit duties within the limits of the Morni tract. His father Qasim Ali Khan II had died at Lahore in 1849-50. His grandfather, Meer Akbar Ali Khan had come under suspicion of British during Revolt of 1857 and Thomas Douglas Forsyth, Deputy Commissioner Umballa partially dismantled the Kotaha fort. The successor to him Melville was a bit liniment on Mir of Kotaha and taking advantage of this Akbar Ali rebuilt the fort without permission. But when Captain Tighe succeeded P. S. Melville as the Deputy Commissioner of Umballa in 1864 and the Mir came under the severe displeasure of the British Government on a charge of conspiracy, and ‘on an attempt to partially rebuild his fort at Kotaha without permission'. This led to demolition of fort and confiscation of their jagir. However, meanwhile, Meer Akbar Ali died in 1864 and young Bakir Ali succeeded him as Mir of Kotaha. Due to his young age he was spared and their jagir of Kotaha was restored to him but at the same time, he was banished from town. However, his whole property in Naraingarh was brought under direct official management. The Government cancelled the sentence of banishment and the property was finally restored to the Mir in 1880.