 Using this representation, we lose information about the string.For example, both the strings "abc" and "bca" give rise to exactly the same 2-gram "bc" (although {"ab", "bc"} is clearly not the same as {"bc", "ca"}).However, we know empirically that if two strings of real text have a similar vector representation (as measured by cosine distance) then they are likely to be similar.