March 2004, largely due to salary cap constraints, Rattay was given the starting job. From 2004–2005 he went 2–11 playing for the 49ers. Tampa Bay Buccaneers On October 18, 2005, Rattay was acquired by the Tampa Bay Buccaneers for a 6th-round 2006 NFL Draft pick from the San Francisco 49ers. Late in the 2006 season, Rattay stepped in as the starting quarterback for the Buccaneers due to the poor play of Bruce Gradkowski. In the week 15 game against the Chicago Bears, he entered the game with Tampa Bay losing 14–3. Due to his strong performance, Tampa Bay tied the game at 31, but they eventually lost in overtime 34–31. This performance led head coach Jon Gruden to name Rattay as the team's third different starting quarterback in the 2006 season. Tennessee Titans On May 9, 2007, Rattay signed as a free agent with the Tennessee Titans. The following month Gruden would name Jeff Garcia Rattay's successor as the Buccaneers' starting quarterback. Rattay signed with Tennessee to be a backup before 2007's training camp. He made the team's 53 man roster, but was cut the next day. Arizona Cardinals On October 9, 2007, Rattay signed a one-year contract with the Arizona Cardinals as a backup to Kurt Warner, following a season-ending collarbone injury to starting quarterback Matt Leinart. Rattay would replace Warner in goal-line situations, where he went 3 for 3 with all 3 being touchdowns. Rattay declined to sign for another year, and decided to test the free agent market. In September 2008, there were rumors that the New England Patriots considered signing Rattay after Tom Brady was lost for the entire 2008 season. In the 2000 NFL draft, the Patriots considered drafting Rattay but opted for Brady instead. The Patriots brought Rattay to Foxboro along with Chris Simms, but once they arrived, they were told that, since Matt Cassel had emerged, the situation had changed and Simms and Rattay were no longer needed in New England. A month later, Rattay worked out with the Detroit Lions, but they never made an offer to him. Las Vegas Locomotives In July 2009, Rattay signed with the Las Vegas Locomotives of the United Football League. Head coach Jim Fassel said that Rattay would serve as the backup to J. P. Losman. On November 21, Rattay started for an injured Losman and led the Locomotives with two touchdown passes in a blowout