How to find all views and panels that use a certain field
In D7, you can see this for views at least at
/admin/reports/fields/views-fields (Admin -> Reports -> Field list -> Used in views)

(Similarly for content types it is at
/admin/reports/fields/ (Admin -> Reports -> Field list)

Don't know about panels though.