Should I use an extension power cord instead?
The extension cord is the part on the right. One came with your power adapter, and it goes between the adapter and the wall. A new one would work fine with your current power adapter but won't do anything by itself.