1. A computer-implemented method comprising: obtaining a query image that was submitted to an image-based search system by a requesting user; obtaining one or more images that are identified as matching the query image; identifying people that are associated with at least one of the one or more images that are identified as matching the query image; for each person that is associated with at least one of the one or more images that are identified as matching the query image, obtaining a score that reflects a level of social connectivity between the person and the requesting user that submitted the query image to the image-based search system; selecting one or more of the people that are associated with at least one of the one or more images that are identified as matching the query image based on the scores that reflect the level of social connectivity between each person and the requesting user that submitted the query image to the image-based search system; and providing a respective identifier of one or more of the selected people to the requesting user.