The site was long known as "Wool Quay", and, from the medieval period, a custom house was necessary there to levy the duty payable on exported wool.
The post-fire replacement was on a rather larger scale, to the designs of Christopher Wren.