Error

#2
by Sagicc - opened

After request get this error
"Input validation error: inputs tokens + max_new_tokens must be <= 32768. Given: 71508 inputs tokens and 0 max_new_tokens
{"error":"Input validation error: inputs tokens + max_new_tokens must be <= 32768. Given: 71508 inputs tokens and 0 max_new_tokens","error_type":"validation"}"

I greeted 'Hi ALfred' and I got the same error message.
Error: Error in generating model output:
422 Client Error: Unprocessable Entity for url: https://router.huggingface.co/hf-inference/models/Qwen/Qwen2.5-Coder-32B-Instruct/v1/chat/completions (Request ID: Root=1-67f8fb2e-0a231650278948ce63026324;5bae414c-d947-4fae-80fd-f35effe2ab6c)

Input validation error: inputs tokens + max_new_tokens must be <= 32768. Given: 84327 inputs tokens and 0 max_new_tokens
{"error":"Input validation error: inputs tokens + max_new_tokens must be <= 32768. Given: 84327 inputs tokens and 0 max_new_tokens","error_type":"validation"}

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment