The rock journalist Lester Bangs wrote in 1979 that the song "is the album's whirlpool.
Artist Mark Wallinger said of "Madame George": "The sense of desire and loss expressed in this song is so sad because it dares one to try to hear it again as if for the first time.