Can I replace a GFCI plug with a regular duplex?
If the GFI was installed originally it is almost certain that it was required. Otherwise why put it in.

By removing it you will be creating a code violation and almost certainly have a less safe installation. 

Just replace the GFI with another GFI.