How to regenerate xmlsitemap to https? I'm new to Drupal community and I wonder if there is a solution to regenerate all urls from http to https?

I have already tried to just regenerate and try to update $base_url in setting, nothing helped.
There is a setting in the XMLSitemap admin configuration that lets you set the base domain. Update that value, clear cache, and regenerate the sitemap.