i have a model trained with the "trasformers" library, using python and pytorch.

if i use a GPU, the model scale well with batches of input data, but if I perform inference using a CPU, the model dosn't scale.

any clues on how to do better?
spam lang_mismatch pii not_appropriate hate_speech sexual_content quality toxicity humor creativity violence