Fix inconsistent casting to bool
Series logical ops (`|`, `&`, `^`) have a bunch of inconsistencies.  This partially addresses one of them, and does so in a way that makes the diff for the next one much more manageable than it would be without this.