Why capacitor voltage getting low even in open circuit?
What you are noticing is known as leakage current or self discharge. It is to be expected.  A supercap is not like a battery that uses a chemical reaction to supply electrical energy, it discharges like a capacitor does.

Here is an interesting plot from Tecate group