 Fischer was born Elfriede Eisler in Leipzig in 1895, the daughter of Marie Edith Fischer and Rudolf Eisler, a professor of philosophy at Leipzig but of Austrian nationality.Her father was Jewish and her mother was Lutheran.She was the elder sister to noted film and concert composer Hanns Eisler and fellow communist activist Gerhart Eisler.