Circuit design review - battery powered attiny with Zener voltage regulator
Jonathan already answered your question with significant detail.

However, you can save yourself a lot of bother, and battery life, if you redesign it like this.







simulate this circuit &ndash; Schematic created using CircuitLab