Red circle appears as cursor
[Few minutes later.]

That is the Grease Pencil Eraser.

Make sure there are no other inputs except for the mouse. In this case there was a graphics tablet with the pen in near proximity.