Chat template for image input?
#19
by
apepkuss79
- opened
The following is an example of my prompt with a question and an image (b64 encoding string). Is it correct in the format? Thanks!
<bos><start_of_turn>user
what is in the picture?
<start_of_image>
<img src="data:image/jpeg;base64,/9j/4AAQSkZJRgABAQAASABI ... 8oTTNwfujOc/hSuhuSsf//Z"><end_of_turn>
<start_of_turn>model
Did this work for you? I am looking for the right format as well
Not sure. I tried it on llama.cpp, but it seems llama.cpp does not support image input for the gemma-3 models yet. BTW, I used ChatGPT to analyze the chat template provided in https://huggingface.co/google/gemma-3-27b-it/blob/main/chat_template.json, and got the format above.