How remove/hide an action field link?
Assuming those operations check access correctly (not doing so would be a bug), you can use hook_ENTITY_TYPE_access, e.g. in your case hook_field_config_access, there you can deny delete access for a field with a given name.