Thinking=True on GGUF?
#7
by
MrDevolver
- opened
How do we set thinking parameter to true on GGUF? 🤔
Hi! We're actively working on an Ollama model with the corresponding go
template. Ultimately, enabling thinking
is a matter of enabling the right section of system prompt, so in the meantime you can use apply_chat_template
on the client side, then use the expanded string with raw generate
.