(Dis-)Advantages of "push-in" to expandable handlebar end plugs
All the simple plastic bar end plugs I've ever used simply fell out at some point.

On a road bike drop bar I find it utterly impossible to tuck bar tape into the end of the bar and secure it with a simple plug. 

There are better designs of expansion plug than the ones you had trouble with. In some expansion plugs the wedge is built into the cap. The bolt pulls the plug against the cap/wedge. When removing, pulling on the bolt does not tighten the plug.