How do integrator circuits serve as memory devices in continuous time system?
An integrator has its current state (value) because of the past values.

That is kind of a memory: It memorizes the sum of the "past".

The green sentence follows from the yellow sentence because the yellow sentence 
defines the integrators as state, and the green sentence just repeats that.