How to remove unlinked/disconnected parts of a bigger mesh?
One thing I could recommend is to select the large object with the hotkey [L]. If there are several islands (isolated parts of the mesh) that you want in the physics simulation, you can select those too. once you have all of the mesh you want selected, then press control I (invert selection) and delete. That should get rid of any unconnected geometry