The name of the village was recorded as Flinbi in 1056 and Flemyngeby in the 12th century, and seems to come from Old Norse Flæminga bý, meaning "the village of the Flemings".
Flimby has three Grade II historic buildings listed by English Heritage.