Cleanup Vertex Weights
You want to be in Weight Paint Mode.  From there, goto Weights >> Clean.  The settings for which threshold you want (if its other than zero) can be found on the tool shelf, on the Clean Vertex group Properties.