1. A system, comprising: a recommendation application stored in memory; and a processor communicating with the memory and with the recommendation application, the system receiving a set of annotations that occurs within a window of time in a segment of content, the system selecting a membership subset having an annotation from the set of annotations, the system querying for related content having the membership subset of the set of annotations, and the system sending a recommendation that recommends the related content, wherein the processor selects at least two annotations from the set of annotations that have a spatial relationship and a temporal relationship, wherein the spatial relationship relates to a proximity between the at least two annotations which may be used to determine a relationship between the at least two annotations and the processor queries for related content having the same spatial relationship and the same temporal relationship.