What is this and how can I remove it?
Those are ceramic towel bar posts.

This type of towel bar is set in with the tile, a tile is cut so there is a space for the towel bar ends to "seat" into, held in by the grout.

If it is removed you may crack or break some surrounding tile, at the least there will be missing tile where the rack was.