Why is there a potential difference between neutral and ground (earth)?
1) Why would you expect a potential difference not to appear? N and earth are tied together only in distribution/transformer boxes, that's a long way till your house, the N wire is usually carrying some current so its potential might slightly differ from ground.

2) If you call tripping the whole house an issue, well that's an issue then. I'd say that safety is not compromised at all, it is instead enforced by this behaviour. Disconnecting also the N through the circuit breaker would work.