Load all configuration that has a particular config dependency?
Figured it out. You need to use wildcards and pass an array of potential matching values.

$form_displays = \Drupal::entityQuery('entity_form_display')
  -&gt;condition('dependencies.config.*', ['field.field.paragraph.call_to_action.field_cta_text'])
  -&gt;execute();