Organic Groups strict membership access
You need to enable Organic groups access control module. This will let you set your groups to public/private.

There is a tutorial series on Organic Groups which explains everything you need to know about the configuration at http://modulesunraveled.com/organic-groups