Is there a way to disable a contact?
When you delete contacts, by default  they go into trash and don't completely disappear so you can still keep them. More info here https://docs.civicrm.org/user/en/latest/organising-your-data/contacts/#deleting-contacts