Keep only new faces from Blender Solidify modifier
From what you said i have a feeling that you didn't apply the modifier

NOTE that you can't apply the modifier if you are in edit mode or the object is linked with another object