Debugging panels visibility rule with custom access check plugin
I found it within a few minutes of posting this question. The issue was in my summary function and my use of placeholder values. Once that was fixed, it was working fine.