CiviContribute Component Settings not saving settings beyond Enable Tax and Invoicing option
I believe this is a regression: follow along here (and do report you're seeing this as well): https://lab.civicrm.org/dev/core/-/issues/1712

And it has been fixed (missed closing it). 

You will want to upgrade your CiviCRM to either 5.24.6 or 5.25.0 (we're not sure when the fix went in).