Khan was educated at Aligarh Muslim University and the London School of Economics.
One of his brothers, Abdul Hamid Khan, was a prime minister of Azad Jammu and Kashmir and other Khan Abdul Rauf Khan was a renowned lawyer.