Removing grout with oscillating tool: too narrow/too high?
It can be done but it will take time and patience.

Where delicacy is a must, power tools are not used as my preference. You could use a grout saw, But I usually use a heavy duty razor knife and change the blades often. You may use a dozen blades perhaps doing a 3'X3' shower.