How to uninstall a module that has added a basefield that has data
This is a known Drupal Core limitation that looks close to being ready so hopefully will be fixed in D8.5.  In the meantime you could apply the patch linked to the issue.