Drupal 7 contexual filter display block based on node reference
Here is what I would do if I am understanding this correctly:

Create a new view block

1.) Create a view with Filter critera:  Content type is book
2.) Then I would create a Relationship to: Content Reader
3.) Add all the fields and add a relationship to the Reader content type (whatever you want displayed from the reader content)
4.) Add a contextual filer with: Content NID, where it says WHEN THE FILTER VALUE IS NOT AVAILABLE click on the Provide default value radio and select Content ID from URL
5.)  Add that block to the story display page wherever needed