index doesn't update
This issue is solved. The issue was a malformed URI that was imported from the Drupal 6 website. The search indexing failed when it encountered this content (comment).

It turns out that it was old spam comments from the D6 site. I was able to delete those and indexing is working now.