Smith was the brother of Francis 'Frans' Smith, (1847-1912), the second Sierra Leonean to qualify as a barrister at the Middle Temple.
Through his father's second marriage to Ann Spilsbury, the granddaughter of Dr. George Green Spilsbury, a colonial physician, Robert Smith was the half brother of Adelaide Casely-Hayford, a well known Sierra Leonean educationalist and writer.