Cycle Combined bake only adds lighting on side of mesh
Found the reason, it was that since it was an empty scene it could only bake unto itself. The surface at the top was facing nothing, whilst the surface on the sides could reflect off of eachother.

That means if you want to have a light source also show up in a picture, that light source needs to be inside of some sort of object, such as a sphere or whatnot.