 In April 1964 he called for the use of high pressure fire hoses to stop hooligans.At the 1964 general election, Pannell lost his seat to Labour.He was keen to stand again to try to regain his position, and was mentioned as a possible Conservative candidate in the Birmingham Hall Green by-election in 1965, although this came to nothing.