LDAP + Workbench or LDAP + OG
Well after much trial and error  which included rebuilding permissions more times that I want to count. I came up with a solution based on the following link:

http://drupal.org/node/200631

A combination of Taxononmy Access Control and Taxonomy on content type, which allows for a almost module-less solution.

Hope this helps someone else.