Plaster in contact with hot wires
First off the fire department won't help you until there is a fire. They don't do electrical work.

The circuit breaker that feeds that wire should be shut off until the receptacle is replaced or the problem is corrected. If the receptacle is to be eliminated the wires should be capped off and a blank plate should be put on the box.

If you, or your partner, are not comfortable doing electrical work, you should call an experienced electrician to correct this and any other electrical problems in the house.

Good luck on your project!