How do I delete these vertices? They are only visible in face selector mode
Those are not vertices, they are faces with a very small area.

To delete them you either:


Select all and remove doubles by pressing W then Remove Doubles;
Or manually remove them and join the vertices by pressing Alt+M.