She is best known for her 1970s hits `` Diamonds & Rust '' and `` The Night They Drove Old Dixie Down '' . Baez had a popular hit song with `` Diamonds & Rust '' and hit covers of Phil Ochs 's `` There but for Fortune '' and The Band 's `` The Night They Drove Old Dixie Down '' .