11. The computer-implemented method of claim 10 , wherein the first characterization of the skill level of the first individual in the specified skill is determined by: requesting a fourth individual to specify one or more individuals having the specified skill; receiving, from the fourth individual, an indication that the first individual has the specified skill; requesting the fourth individual to characterize the skill level of the first individual in the specified skill; receiving, from the fourth individual, a fourth characterization of the skill level of the first individual in the specified skill; requesting a fifth individual whether the fourth characterization accurately describes the skill level of the first individual in the specified skill; and programmatically determining the first characterization based on the fourth characterization and a fifth characterization received from the fifth individual, wherein the first characterization matches the fourth characterization if the fifth characterization confirms that the fourth characterization accurately describes the skill level of the first individual in the specified skill.
10. The computer-implemented method of claim 9 , wherein the count of the plurality of individuals characterizing the skill level of the first individual is identified by accessing the data store, wherein the count is incremented upon receiving the second characterization from the second individual, wherein the count is not incremented upon determining that the plurality of individuals is, in number, equal to or greater than the predefined count of individuals characterizing the skill level of the first individual; wherein requesting at least the second individual to provide a second characterization comprises: requesting one or more individuals, including the second individual, to characterize the skill level of the first individual, such that: (i) a sum of: (A) a count of the one or more individuals and (B) the count of the plurality of individuals equals the predefined count of individuals; and (ii) a final characterization of the skill level of the first individual in the specified skill is programmatically determined, such that no individual beyond the predefined count of individuals is requested to characterize the skill level of the first individual and such that the final characterization is not subsequently modified based on input from any individual.