What does "finding an optimal action" for a bandit mean?
In the bandit setting, to each arm is associated an unknown reward distribution. The optimization goal is to find a policy (a series of level pulls) which yields the maximum sum of rewards. 

"Finding an optimal action" thus refers to the process of discovering the arm which gives you the most reward.