alexwww94

/

glm-4v-9b-gptq-4bit

like 6

What HF version supported?

Name: transformers
Version: 4.48.0
Currently get error:

Traceback (most recent call last):
File "/home/pong/llm/lmdeploy/GLM-4/basic_demo/glm.py", line 47, in
inputs = tokenizer.apply_chat_template([prompt],
File "/home/pong/.cache/huggingface/modules/transformers_modules/alexwww94/glm-4v-9b-gptq-4bit/40bbb0c6b77139834dd43426949d71b2aec45918/tokenization_chatglm.py", line 253, in apply_chat_template
output = self.batch_encode_plus(
File "/home/pong/llm/lmdeploy/GLM-4/basic_demo/venv/lib/python3.10/site-packages/transformers/tokenization_utils_base.py", line 3158, in batch_encode_plus
return self._batch_encode_plus(
File "/home/pong/llm/lmdeploy/GLM-4/basic_demo/venv/lib/python3.10/site-packages/transformers/tokenization_utils.py", line 892, in _batch_encode_plus
batch_outputs = self._batch_prepare_for_model(
File "/home/pong/llm/lmdeploy/GLM-4/basic_demo/venv/lib/python3.10/site-packages/transformers/tokenization_utils.py", line 970, in _batch_prepare_for_model
batch_outputs = self.pad(
File "/home/pong/llm/lmdeploy/GLM-4/basic_demo/venv/lib/python3.10/site-packages/transformers/tokenization_utils_base.py", line 3374, in pad
outputs = self._pad(
TypeError: ChatGLM4Tokenizer._pad() got an unexpected keyword argument 'padding_side'