Why is voltage output inverted between common-emitter and common-collector amplifiers?
No, you are mistaken in your analysis. When the base is driven harder in a common collector NPN circuit, the transistor passes more current from collector to emitter and this raises the emitter voltage with respect to 0V.

In a common emitter circuit, with a higher base drive, the collector voltage falls towards 0V potential.