dfurman commited on
Commit
4f6b36f
·
1 Parent(s): 27647ae

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -2
README.md CHANGED
@@ -162,7 +162,7 @@ Shake all ingredients except the splash of grenadine in a cocktail shaker over i
162
  ## Speeds, Sizes, Times
163
 
164
  | runtime / 50 tokens (sec) | GPU | dtype | VRAM (GB) |
165
- |:-----------------------------:|:----------------------:|:---------------------:|:-------------:|:-----------------------:|
166
  | 3.44 | 1x A100 (40 GB SXM) | torch.float16 | 16 |
167
 
168
  ## Training
@@ -177,7 +177,6 @@ This model was finetuned with the following format:
177
  tokenizer.chat_template = "{{ bos_token }}{% for message in messages %}{% if (message['role'] == 'user') != (loop.index0 % 2 == 0) %}{{ raise_exception('Conversation roles must alternate user/assistant/user/assistant/...') }}{% endif %}{% if message['role'] == 'user' %}{{ '[INST] ' + message['content'] + ' [/INST] ' }}{% elif message['role'] == 'assistant' %}{{ message['content'] + eos_token + ' ' }}{% else %}{{ raise_exception('Only user and assistant roles are supported!') }}{% endif %}{% endfor %}"
178
  ```
179
 
180
-
181
  This format is available as a [chat template](https://huggingface.co/docs/transformers/main/chat_templating) via the `apply_chat_template()` method. Here's an illustrative example:
182
 
183
  ```python
 
162
  ## Speeds, Sizes, Times
163
 
164
  | runtime / 50 tokens (sec) | GPU | dtype | VRAM (GB) |
165
+ |:-----------------------------:|:---------------------:|:-------------:|:-----------------------:|
166
  | 3.44 | 1x A100 (40 GB SXM) | torch.float16 | 16 |
167
 
168
  ## Training
 
177
  tokenizer.chat_template = "{{ bos_token }}{% for message in messages %}{% if (message['role'] == 'user') != (loop.index0 % 2 == 0) %}{{ raise_exception('Conversation roles must alternate user/assistant/user/assistant/...') }}{% endif %}{% if message['role'] == 'user' %}{{ '[INST] ' + message['content'] + ' [/INST] ' }}{% elif message['role'] == 'assistant' %}{{ message['content'] + eos_token + ' ' }}{% else %}{{ raise_exception('Only user and assistant roles are supported!') }}{% endif %}{% endfor %}"
178
  ```
179
 
 
180
  This format is available as a [chat template](https://huggingface.co/docs/transformers/main/chat_templating) via the `apply_chat_template()` method. Here's an illustrative example:
181
 
182
  ```python