 They subsequently became members of the South East Anglian League in 1904 and finished bottom of the league in 1905–06.They rejoined the Norfolk & Suffolk League in 1920, leaving again in 1929 and rejoining again in 1932.During this time they also played in the Essex & Suffolk Border League.