my subdiv modifier pulls the model out of shape
The issue you are having is caused by not connected topology, those faces are separated from the rest of the mesh. Let me illustrate:

This is how a basic plane looks with a Subdivision Surface modifier:



Notice that the edges are all rounded. Now if I extrude an edge, it will remain connected, while if I duplicate it then it is disconnected and I will need to remove doubles: