To do this, head to the nearest Stables (marked by a horse shoe) on your map, and head into the barn. In here, you can tab between your horses, and if you select the 'Services' option, you'll be given the opportunity to rename your horse then and there (no swear words, please).