Kiyonga was born in Kasese District in western Uganda in 1952.
From 1973 through 1978, he attended Makerere University School of Medicine where he obtained his first medical degree, the Bachelor of Medicine and Bachelor of Surgery (MBChB) in 1978.