Is it safe for a CR2032 coin cell to be in an oven?
So, first of all, CR2032 is a Lithium Battery type, so, yes, overheat it and it has a good chance of exploding/combusting.

I'd really just go and use some cable to get the sensor into your oven, and keep the battery on the outside. Less trouble, more reliability, less isolation that could fail.