 Ruffell left the east London club in 1937.He joined Aldershot for a short spell, where he made two League appearances and played his final game against Port Vale.His brother Bill was also a professional footballer who had been on the books at West Ham and played League football for Nelson during the 1927–28 season.