Reinforcement learning with sparse acting agent
One option is to create a reward function to incentivize the behavior you want:


Small positive reward for doing nothing.
Large positive reward for doing the rare, correct action.
Negative reward for taking action when no-action is correct.
Negative reward for taking incorrect action.