Drupal views: Civicrm drupal_id entity missing after update?
The problem has disappeared.

Ehm, I cleared caches. Fairly sure I cleared caches the first time, but I did it again, now using the UI, and all looks normal now.