We have presented a framework for benchmarking multi-step retrosynthesis, i.e. route prediction, methods, and we call this framework PaRoutes (patent routes). PaRoutes consists of two sets of synthetic routes extracted from patent literature and corresponding compound stocks to be used as stop criteria for the retrosynthesis. Furthermore, it provides a curated set of reactions that can be used to train onestep retrosynthesis models. Finally, PaRoutes provides scripts to compute quality metrics: top-n accuracies and route diversity. The entire framework is provided open-source with detailed instructions on how to use it. The framework is available at