Same material different result within object
Solution:
After fiddling around for while with the issue, recreating and mapping the room also redoing the material and lights ending up with the same problem. The solution to the problem was adding a normal map node in between the Image texture and Diffuse BSDF

Result:


Thank you everyone for input, hope this helps out someone in the future.