Suppose I would like to verify that the ground terminal on an indoor power outlet is actually connected to the ground (from what I've read, some of them aren't!). How would I go about checking that?

I ask because I recently purchased an ESD wrist strap, but I know it's useless unless it's actually connected to the earth.