Stochastic multi-armed bandit problem with transition costs
Yes, it's been studied -- for example you can look at this survey, which is from the econ community.

Also, [Auer '02] considered a similar problem, which he called "shifting bandits" where the learner has to compete with the optimal policy that's allowed to make $s$ shifts, in the adversarial setting -- see section 3 of this paper.