What adhesive should I use to glue rigid polystyrene insulation to itself and to wood?
"Project adhesive" or "panel adhesive"  is a variation of construction adhesive that's water-based. It doesn't have solvents that eat foam, and it has reasonably good grab.