Should I use a current limiter on a battery powered system
You haven't said anything about the current draw of your system, how much inrush you expect, nor the type of battery, so the question can't be answered directly.  However, it is unlikely that inrush current from occasionally turning something on is going to matter to the battery or the power supply input circuitry.  If you are just powering a few 10s of mA of ordinary electronics, then you are overthinking this.