Baked normals not calculating gradient smoothly when using a depth map
Your saved image doesn't have enough color informations.
Save baked pass in OpenEXR format that can save information in unclipped bit depth.