Why are electrons not pushed out from the conductor at an open circuit under the influence of a power source?
You're imagining an open circuit to look like this:



A better analogy would be this:



The pipes in a circuit aren't surrounded by free space for the water to flow -- they are tunnelled through a rock. Where there is no pipe, there is just rock and the water does not flow.