Panelizer: displaying node reference field
You'll have to create a custom formatter where you can control the output of the node reference. To create a custom formatter follow this tutorial: http://www.metaltoad.com/blog/drupal-7-tutorial-creating-custom-formatters

After that in panels when you add the node reference you can choose the custom formatter you've created: