During this time he found work as chief storeman at a munitions factory in Ayrshire, and he also joined the Home Guard. Kilmarnock finally returned to playing football again in the summer of 1944, although they had to play their home games at a nearby junior team's ground as Rugby Park was still being used by the army. Eventually their ground was returned to them in April 1945, and the club joined the Southern League for the forthcoming season. However, in July 1945 a Glasgow newspaper reported that McGrory would "make a sensational move soon." He himself later confirmed that Tom White, the Celtic chairman, had telephoned to arrange a meeting. McGrory duly travelled to Glasgow to speak with him, and was offered the job as manager of Celtic. Celtic manager On 24 July 1945, McGrory returned to Parkhead to manage Celtic. His first season proved to be difficult, with the side comprising an uneasy blend of veterans and youngsters. Winger Jimmy Delaney's sale to Manchester United in February 1946, after asking Celtic for a £2 rise in his weekly wage, and the transfer of Malky MacDonald to Kilmarnock further weakened the side. The season then ended in controversy when Celtic lost to Rangers in the semi-final of the Victory Cup, with numerous dubious decisions made against Celtic by a referee who appeared to be affected by alcohol. Celtic made a poor start to the following season, winning only one of their first five games. A further defeat against Third Lanark in September 1946 saw a large number of fans protest outside the ground, although it was the chairman Tom White who was subject of their criticism and not McGrory. In March 1947, Tom White died and director Robert Kelly was elected as his successor as chairman. For the next 18 years, Kelly would be the dominant personality at Celtic Park; imposing his will in the running of the club at all levels including having direct involvement in team selection. In 1948, the club endured an even worse season, and went into their last league game of the season with the possibility of being relegated. Celtic went on to win 3–2 against Dundee, to the relief of all associated with the club. McGrory later described Celtic's flirtation with relegation as "the worst experience I've ever had in football." In June 1948, McGrory signed Charlie Tully from Belfast Celtic for £8,000.