We introduced a voting system to help identify bad edges, meaning transformations that likely have not converged yet. Even this relatively small dataset of 16 ligands resulted in 87 different ligand cycles which made it difficult to identify which specific transitions were unconverged by manually looking at the cycle closure errors. Our voting system provided a more automated way to assess this. In this voting system, if a cycle had a cycle closure above a certain threshold (0.7 kcal/mol), each transformation in the cycle was assigned a penalty (+1), while each transformation in a cycle with a cycle closure below a certain threshold (0.3 kcal/mol) received a positive vote (-1). The votes for each transformation were then summed up and the edges with the most positive overall votes were investigated further to identify potential sampling problems.