Terminal command to change Privilege of "everyone" to "No Access"
chmod 700 /path/to/folder should do the trick for you. This allows execute (1), write (2), and read (4) for the owner, and no access for everyone else.