Publication ethics - rights of a co-author to access full data
In order for the benchmarking exercise to be convincing to readers, it will ultimately be desirable to release all of the data (and presumably code) so that the comparison can be replicated.  

There's no reason that the ground truth data couldn't be revealed to all participating researchers after they've done their analysis and the results have been frozen but before the submission of the paper.