Cannot join armatures without mesh detaching
Did you apply scale to the rig/armature after re-sizing the armature? If you don't apply scale (Ctrl+A) the mesh will not follow it. 
Or are you trying t o"join" them together? Ctrl+J.