Sealing porous basement common-wall for smells
You could go the olde-fashioned route and gypsum plaster the whole thing.

You could go new-fashioned and mud it with a skimcoat of drywall compound. 

You could also slap up a layer of drywall first and then just tape and mud the joints. This might well be the cheapest &amp; quickest option.

After checking VERY carefully for larger holes that might need something like ductseal or plaster to plug them, if the wall itself is really "porous" you could use a water-based "waterproofing" paint, such as UGL drylock (they have "paint" and "Waterproofer" - the former is thinner and covers more per gallon, the latter is thicker and covers less area - either might work but the waterproofer would be more like what you are asking for.)

You might need to caulk around the edges. You can get clear silicone caulk that is rated for food contact and aquarium use (check the fine print) and all it "gives off" is a bit of vinegar during a fairly short cure period.