When evaluating MSMs using a variational score one must specify both the Markov lag time (τ ) and the number of eigenvectors to score (k). However, both these choices affect the VAMP score although it is not clear whether these choices affect the model ranking. To . Across all lags and for both small (k=2) and large (k=10) numbers of scored eigenvectors, the consistency in the model ranking is high (greater than 85 %). The consistency between models with lag times τ >1 ns is much greater, with rank correlations up to 100 %.