How to resolve these artifact looking after apply normal map?
The problem has been resolved. It is caused by the missing info from the normal map.
To fix the normal map, I used Photoshop to clean those spots, and it works just fine without baking another one.