I got better and improved results later of one chapter of my published PhD thesis
Improving on results is how science works. You should publish the results and be happy you did better!

As for minor mistakes, I would consider adding a short errata section as a supplementary file in your university database (if they allow it), or in your personal website if you have one. In either case this is perfectly normal and standard, don’t feel bad!