How do I make remove the "tufts" and get this to be better rounded?
Avoid using polygons with more than 4 edges(except on hard flat non deforming surfaces)....that is where your issues are coming from...there are no edges for the subdivisions to adhere to.