BUG: Interval scalar arithmetic operations reset closed
- [X] closes #22313
- [X] tests added / passed
- [X] passes `git diff upstream/master -u -- "*.py" | flake8 --diff`
- [X] whatsnew entry

Including this with 0.24.0 for the time being; I think this would be easy to backport into 0.23.5 since this looks to be disjoint from the other interval related changes but thought it best to play it safe.