To the best of the authors' knowledge, it is the first of this kind of assessment. Although benchmarks are available in cheminformatics, they focus on the outputs of the CASP tools or on synthetic accessibility scores alone . This assessment can be easily reproduced for evaluating the accuracy of synthetic accessibility scores developed in the future. Its source code is publicly available at . com/grzsko/ASAP.