Views display labels with empty fields
Yes, under Advacned Options for the View there is a No Results option. You can set a global text result as an example and say "sorry no values found." Then under the Table format Settings there is a checkbox to show No Results text in Table. That will replace the empty row with your message -- while still showing the table headers.