From 1981 through the first 12 games of the 1985 season, he was the head coach of the New Orleans Saints, and as in his coaching tenure with the Oilers, Phillips took off his trademark Stetson inside the Louisiana Superdome.
Phillips resigned as Saints coach on November 25, 1985, one day after a 30-24 victory over the Minnesota Vikings.