Is it OK to replace a 15A outlet with 20A outlet as long as it's already on a 20A breaker?
Yes, you can do that but it would have to be a 20 Amp GFCI outlet.  It's always a good idea to check the wire size to make sure you have #12 AWG wire.