Is it possible to set "Do not mail" -- but only for a time
https://civicrm.org/extensions/do-not-contact-until
May not be compatible with latest version of CiviCRM as it hasn’t been updated for a number of years.