Electrical socket working for washer but not sump pump
Yes you should replace the socket. If there are any signs of heat damage on the plugs then you should replace those too.

It sounds like the contacts in the socket are going bad and are just about making contact with one plug and not the other. Socket contacts that are only just about making contact are not a good thing.