User Management Question
What I am seeing here is an entity with a bunch of other entity reference fields.
This followed by a bunch of access permission settings.


  some users can be assigned as the admin of a group that can add users to that group


Create a "group" entity that has 2 entity references fields (multivalue) one for users and one for admins. Each referencing the users and the admins who can have privileges.


  make sub groups and assign admins to it to add users...


Add another entity reference field to reference the same group entity type as the parent


  all the users need to have permissions to add edit and view some info that will be part of a large module I am creating...but unique to each user/subuser.


You would just need to play around the access control for that particular entity using a module like https://drupal.org/project/content_access or other ACL modules