 Our soft sell with Tainted Love and Where Did Our Love Go? We found out that the song We Didn't Start the Fire from Billy Joel had 119 cultural references in it earlier. And some more fun facts about that song, it would be Billy Joel's third U.S. number one hit. His previous two were It's Still Rock and Roll to Me and Tell Her About It. And Billy Joel actually said the song was basically a novelty song and an example of his distaste for many hit songs.