Add description to each entity reference
If you are looking for a code solution, you can do this in a custom field type, see this answer https://drupal.stackexchange.com/a/231162/47547. 

If you want to do this in UI, you can use Field Collection or Paragraphs to bundle the two fields entity reference and description.