numer.ai: how does their leaderboard system work?
I found the answer in the comments section of their blog:


  Earnings listed on the public-score leaderboard are potential winnings. Actual winnings are determined by the private-score leaderboard. At the time of withdrawal and when new datasets are released, your actual winnings will be revealed to you.