Segment Groups

We really need groups to be segmented. I need my managers to be able to see Analytics for their group only, without seeing people outside of their group. 

Currently, the only way to accomplish this is to give the manager access to view a course. So that will allow them to see people outside of the group. This is a showstopper for us. 

How do others handle this?