Two relationships in Views
You will want you view set up so that:


The view is displaying Users.
There is a relationship from User to Group
There is a relationship from Group to Manager
You add the contextual filter that defaults to the currently logged in user. Make this filter use the Group-Manager relationship.