Shadow Catcher object causing brightness issues in scene
I went back and looked at one of cegaton's solutions to a similar question and figured out how to fix it.  I simplified my compositing nodes and the problem seems to be gone.