Hello I was reading the Cassandra documentation on Token Function,

[![Screenshot of documentation, https://docs.datastax.com/en/cql/3.1/cql/cql_using/paging_c.html](https://i.stack.imgur.com/PoeKh.png)](https://i.stack.imgur.com/PoeKh.png)

I am trying to achieve pagination for a Cassandra table, I am unable to understand the lines highlighted. The document speaks about the difference between k > 42 and TOKEN(k) > TOKEN(42), but I am not able to understand the "token based comparison"

Looking forward for a detailed explanation of what token function does when part of a WHERE clause.