Solidify makes plane thicker outwards
Nope, you're not doing anything wrong, that's the way Solidify works.  You can make it solidify in the other direction by specifying a negative Thickness or by adjusting the Offset.