Add/Remove User Role on Node View
Try creating a condition that the user have the role, before trying to remove it. 
Also, you could look into Rules Link - you may be able to add it to a custom Profile Page, allowing the user to access and change their settings via My Account - at least from a UI standpoint it might make more sense.