update metric to support new dataset repr, and evaluating multiple suites in one call 5cd2907 jgauthier commited on Jul 8, 2022
disable truncation. longer sequences are handled just fine, AFAICS af46379 jgauthier commited on Jul 7, 2022
add tokenizer config from perplexity metric. truncation breaks tests 4bd2962 jgauthier commited on Jul 7, 2022
