Chainring rubbing frame after replacing
Okay, thanks for everyone's time for commenting but I solved the problem.
After getting home, I immediately rechecked the bolts and disassembled the crank and boy oh boy, found out that I put the inner chainring the other way around. In my excitement when installing the new chainring, I didn't realize that I'd put it the wrong way and also didn't realize anything weird during my ride because I haven't actually used the 34T ring yet.

So, my stupidity costed me a bit of paint on my chainstay that I ended up covering with electrical tape, but all good now.