Covalent inhibitors have become a powerful asset to target specific proteins, and covalent docking algorithms are under development to improve CADD of such compounds. In this study, we first created a diverse, manually curated, high-quality benchmark set of covalent ligand-protein complexes, called CSKDE95. This open-access set provides a basis for benchmarking other covalent docking algorithms in the future.