How to make a case sensitive entity query?
Like you already said, I think you should set case_sensitive to true in the field settings, like here. This can also be set in the config.
When digging in the code, I found that the condition function at some point leads to translateCondition which checks if a field is case sensitive and automatically applies the binary option to the sql query.