How to smoothen out a pit in a curved surface
One way is to use the Cast modifier.


Select the area you want to 'smoothen' and add it to a vertex group (I named it ball part)
Add a Cast modifier set to Sphere and limited to the vertex group.
Use the Factor, Radius and Size sliders to correct the shape.