In February 1796 Foster returned once more to Wadsworth Lane, and remained there until early in 1797 he became minister of a general Baptist congregation at Chichester.
Foster became involved in a controversy between the Serampore missionaries, Carey, Marshman, and Ward, and the committee of the Baptist Missionary Society, strongly siding with the missionaries.