Is there just a carrier in each frequency band in FDMA?
That's undefined.

FDMA just says that different users use different parts of the spectrum.

What these users do within "their" frequency ranges is up to the system to define.