The color of my object changes when I use Shadow Catcher
So, I figure the answer. It's because the first picture there is no plane under the head but the one with the shadow catcher has a plane which I guess reflects the light which brighten the head. My nodes setup is simple, it's principled shader to the material output.