Database 4 byte UTF-8 support not properly checking
I fixed it by manual setting the drupal_all_databases_are_utf8mb4 variable to true. You can do this by using drush or setting it in the database and then clear all caches.