Why is there a need for an eNVM and an eSRAM in the same SoC FPGA
eNVM is nonvolatile and has a limited number of write cycles.

eSRAM is volatile and has an effectively infinite number of write cycles. (Probably much faster, too.)

A typical application needs both kinds of memory.