Why is my render darker after joining geometry?
So I figured out what was happening. Shadow ray visibility was disabled for the glass. When I merged the glass with the frame, shadow ray visibility got enabled again.