professional terms with the club in 1998, and made his debut on 5 January 1999 in a 3–0 home defeat against Walsall in the Football League Trophy. He appeared once more later in the season, making his league debut in April 1999, in a 1–0 defeat against Lincoln City. At the start of the following season, he was regularly on the substitutes bench, but due to the poor form of first choice right-back Stuart Fraser he was given the opportunity to start the match at home against Chesterfield on Boxing Day. He kept his place in the starting lineup and played 30 times in the league during the season, and scored his first goal for the club in a 2–1 defeat against Bournemouth in February 2000. Boyce started the 2000–01 season in the centre of defence. New Luton manager Ricky Hill praised Boyce for his "tremendous" displays, and felt he deserved a call-up to the England under-21 squad. He played 42 times in the league, scoring three goals as Luton were relegated to the Third Division. Boyce was a key figure in the following season for Luton as they gained promotion back into the Second Division, and he was rewarded with a new two-year contract. Despite strong competition for places, he continued playing regularly for Luton in the 2002–03 season, making 34 appearances in the league. During his final season with the club, he made 42 league appearances, scoring four goals, and his performances were recognised when he received the Players' Player, Supporters' Player and Internet Player of the Season awards. In the summer of 2004, he rejected a new contract with Luton and decided to leave the club after his existing contract expired. Crystal Palace Following a short trial, Boyce moved to Crystal Palace in July 2004 on a free transfer, signing a two-year deal with the club. He made his debut on 14 August 2004 in Palace's opening Premier League game against Norwich City, and quickly established himself as the club's first-choice right back, and played in almost every league game for the club until a foot injury in March 2005 ruled him out for the rest of the season. The incident occurred during a training session, shortly after Boyce had signed a new deal extending his contract until 2007. Palace were then relegated on the final day of the season after drawing in their match against Charlton