How can I supply 5v voltage to circuit in a portable way?
First, if it's really that important that this device be small and the batteries minimal, design it for 2.5-3.3 V power.  Then you can use a coin cell directly.  You will also find that most parts that run from this power voltage will draw less power than when running from 5 V.

Second, you can convert between voltages with a switching power supply.  However, these things will have some losss.  Right now you're getting (5 V)/(9 V) = 56% efficiency.  A small booster from a single AAA cell can do better than that, and the energy density of a typical AAA cell is better than of a typical 9 V battery.

However, it's difficult to make recommendations without knowing what the current demand is.  If it's 10 mA, then a coin cell isn't ever going to work, for example.

When designing for low power, you have to take the whole design into account, not just try to find the best power supply once other choices have been made that didn't consider low power.