How to make part of the mesh follow a bone without deforming it
Like it was stated, you need to remove unneeded vertex groups from the shield.

In Weight Paint mode, select the vertices you want to clear. Back in the Vertex Groups, click the down arrow icon. There's an option to either remove all groups from selected vertices, or only the active group. Best to remove all groups in your case and manually add the driving group back.