Do Gods and Goddesses regain their power inside dungeon?
They never lost it. Aside from the rule of them not being allowed in the Dungeon, it is also stated at the beginning of all three forms of the series (anime, manga and LN) that the Deities are not allowed to use their power while they reside in the human world.