Is the sum of all FFT bins from Audacity equal to RMS amplitude?
This is expected and a consquence of Parseval's theorem.

Loosely speaking, it's a flavor of energy conservation: the total energy of the signal doesn't change when you transform it from the time domain into the frequency domain so the energy calculated in either domain must be the same.