Reinstall a module that has .yml file in config\install
See How to remove mymodule configurations on uninstall for a best-practice solution.

Basically, you can enforce the dependency on your module in your configuration files.  So when the module is uninstalled, it's associated configuration will be uninstalled as well.