In 1983 Richardson returned to Ottawa to serve as Deputy Chief of Staff to the newly elected Progressive Conservative leader and Leader of the Opposition Brian Mulroney.
After the 1984 federal election, Richardson served as Prime Minister Mulroney's Deputy Chief of Staff and Special Advisor on Western Affairs.