French Rolling Pin Care and Maintenance
You don't need to oil it. Don't wash it, just wipe it as you suggest, and the oils it absorbs from pastry etc will do the job for you.

Your current one may smooth out a bit once it's absorbed some oil. If not, grab a new one.