Bevel tool creating unexpected geometry
Nevermind, I should do more research before posting. The problem was that the normals got messed up. The answer can be found under this post:
Why my Bevel move verticies along the edges instead of bevel them?