Chat template for image input?

#19
by apepkuss79 - opened

The following is an example of my prompt with a question and an image (b64 encoding string). Is it correct in the format? Thanks!

<bos><start_of_turn>user
what is in the picture?
<start_of_image>
<img src="data:image/jpeg;base64,/9j/4AAQSkZJRgABAQAASABI ... 8oTTNwfujOc/hSuhuSsf//Z"><end_of_turn>
<start_of_turn>model

Did this work for you? I am looking for the right format as well

Not sure. I tried it on llama.cpp, but it seems llama.cpp does not support image input for the gemma-3 models yet. BTW, I used ChatGPT to analyze the chat template provided in https://huggingface.co/google/gemma-3-27b-it/blob/main/chat_template.json, and got the format above.

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment