How can I determine what is emitting chemical fumes in my home?
I doubt if it’s the styrofoam you’re smelling. It’s probably the chinking, especially if you’ve reinstalled or touched up lately. 

All of the chinking manufacturers caution against touching, rubbing, etc. because of skin irritations and caution about inhalation.