The Robb House is significant for its association with William Robb, partner in the East Point Rice Mill, and with philanthropist William King McDowell.
Charleston County had bid $273,000 in January 1983 for the building to use it as the location for its Substance Abuse Commission.