1. A method of providing recommendations of real-time content, comprising: selecting, by a first selection engine executing on a data processing system, at a first frequency, a first set of content item identifiers from a first database of a content publisher, the first database containing the first set of content item identifiers determined to be provided at a first rate greater than a first predetermined threshold during a first time period; updating, by an update engine executing on the data processing system, at the first frequency, a first pipeline with the first set of content item identifiers; selecting, by a second selection engine executing on the data processing system, at a second frequency different from the first frequency, a second set of content item identifiers from a second database of the content publisher, the second database containing the second set of content item identifiers determined to be provided at a second rate greater than a second predetermined threshold during a second time period longer in duration than the first time period; updating, by the update engine, at the second frequency, a second pipeline with the second set of content item identifiers; and producing, by an amalgamator engine executing on the data processing system, a combined set of content item identifiers comprising a subset of the first set of content item identifiers and a subset of the second set of content item identifiers.