 On 13 October 2009 the defender left Hearts to return to Cowdenbeath, signing a two-year deal with the side.After six years with the club, Cowdenbeath agreed to terminate Armstrong's contract in November 2015 to enable him to pursue other career opportunities.Shortly after leaving Cowdenbeath, Armstrong signed for Scottish Junior side Edinburgh United.