Text Generation
Transformers
Safetensors
English
qwen2
conversational
text-generation-inference
alpayariyak commited on
Commit
26a4129
·
verified ·
1 Parent(s): 70db380

Add usage recommendations

Browse files
Files changed (1) hide show
  1. README.md +7 -0
README.md CHANGED
@@ -102,6 +102,13 @@ Our model can be served using popular high-performance inference systems:
102
 
103
  All these systems support the OpenAI Chat Completions API format.
104
 
 
 
 
 
 
 
 
105
  ## License
106
  This project is released under the MIT License, reflecting our commitment to open and accessible AI development.
107
  We believe in democratizing AI technology by making our work freely available for anyone to use, modify, and build upon.
 
102
 
103
  All these systems support the OpenAI Chat Completions API format.
104
 
105
+ ### Usage Recommendations
106
+ Our usage recommendations are similar to those of R1 and R1 Distill series:
107
+ 1. Avoid adding a system prompt; all instructions should be contained within the user prompt.
108
+ 2. `temperature = 0.6`
109
+ 3. `top_p = 0.95`
110
+ 4. This model performs best with `max_tokens` set to at least `64000`
111
+
112
  ## License
113
  This project is released under the MIT License, reflecting our commitment to open and accessible AI development.
114
  We believe in democratizing AI technology by making our work freely available for anyone to use, modify, and build upon.