With Arsenal, Graham was a runner-up in both the 1968 and 1969 League Cup finals, before finally winning a medal with the 1969-70 Inter-Cities Fairs Cup.
Winning the Double brought the attention of Scotland and Graham was selected for the national side for the first time against Portugal on 13 October 1971.