Cuomo said that he felt the song was "too cheesy" and didn't know if the song represented the sound he was going for with the band's music.
An early demo of "Buddy Holly" recorded by Cuomo in 1993 has a different feel, as the song is played at a much slower tempo, than the version that appears on the album.