As a result of the first fully inclusive democratic elections in 1994, Phosa was appointed as the first premier of Mpumalanga, a position which he held until 1999.
During the 2007 Conference of the ANC (the 52nd National Conference) held in Polokwane in the Limpopo Province, Phosa was elected to the post of Treasurer General for the Organisation.