Can I (and should I) remove old unused electrical wiring?
There's no problem, conceptually, with removing wiring that doesn't do anything. But your problem isn't the should I, it's the can I.

So to answer your question: Yes, feel free to remove it.

But you have to figure out how to squeeze your arms behind plaster walls and pull staples. :(