While Ipswich where riding high in the Premiership, Naylor once again found himself out of favour with then manager George Burley.
Naylor played a key role in Ipswich's promotion pushes in 2003-04 and 2004-05 where the club would lose in the semi-finals to West Ham United and went on to become a staple for club in the less successful 2005-06.