How do i stop the normal map from offsetting light?
I'm not sure what the normal map is doing but try turn the roughness down to see if it can combat whatever is happening. Also try applying a different normal map and see if it still offsets the light, and post pictures of the results.