Separate power supply for ADXL362 (independent of MCU)
I figured out that adding three 330 ohms resistors in between MISO / MOSI and SCK resolved my communication problems. I still don't really know why it works but it does.

I was inspired by the images in this rather unrelated issue.