How to bake texture with same brightness as original?
As it turned out the simplest solution to this problem was to make the world white and disable any lamps to make sure every part of the mesh gets the same amount of light. Blender Internal would be a good alternative but if you're working in cycles you probably don't want to redo all settings after switching back. (Though I do think the setting will stay)