sophosympatheia commited on
Commit
3599ab0
·
verified ·
1 Parent(s): e596d25

Update mergekit_config.yml

Browse files

Updating to show how I fixed the tokenizer issues

Files changed (1) hide show
  1. mergekit_config.yml +2 -0
mergekit_config.yml CHANGED
@@ -15,3 +15,5 @@ parameters:
15
  value: [0.25, 0.35, 0.55, 0.35, 0.25]
16
  - value: 0.45 # default for other components
17
  dtype: bfloat16
 
 
 
15
  value: [0.25, 0.35, 0.55, 0.35, 0.25]
16
  - value: 0.45 # default for other components
17
  dtype: bfloat16
18
+ tokenizer:
19
+ source: deepseek-ai/DeepSeek-R1-Distill-Llama-70B #necessary to fix tokenizer