Ahmadzei's picture
added 3 more tables for large emb model
5fa1a76
This will
truncate token by token, removing a token from the longest sequence in the pair until the proper length is
reached.