Why does a Common Base amplifier gives non inverting output?
No. When \$V_E\$ increases, \$I_E\$ decreases, because \$V_{BE}\$ decreases. Any extra current that flows through \$R_E\$ is supplied by the signal source, not the transistor.