Drywall mud on ethernet connectors
Water is useful to soften drywall mud.  Be aware, however, that it may take some time.

You might try a wet rag placed over the connector and then try to remove the bulk of the material with tweezers or a small tool.  Be careful not to bend any of the pins inside the connector.