Update README.md
Browse files
README.md
CHANGED
@@ -162,7 +162,7 @@ Shake all ingredients except the splash of grenadine in a cocktail shaker over i
|
|
162 |
## Speeds, Sizes, Times
|
163 |
|
164 |
| runtime / 50 tokens (sec) | GPU | dtype | VRAM (GB) |
|
165 |
-
|
166 |
| 3.44 | 1x A100 (40 GB SXM) | torch.float16 | 16 |
|
167 |
|
168 |
## Training
|
@@ -177,7 +177,6 @@ This model was finetuned with the following format:
|
|
177 |
tokenizer.chat_template = "{{ bos_token }}{% for message in messages %}{% if (message['role'] == 'user') != (loop.index0 % 2 == 0) %}{{ raise_exception('Conversation roles must alternate user/assistant/user/assistant/...') }}{% endif %}{% if message['role'] == 'user' %}{{ '[INST] ' + message['content'] + ' [/INST] ' }}{% elif message['role'] == 'assistant' %}{{ message['content'] + eos_token + ' ' }}{% else %}{{ raise_exception('Only user and assistant roles are supported!') }}{% endif %}{% endfor %}"
|
178 |
```
|
179 |
|
180 |
-
|
181 |
This format is available as a [chat template](https://huggingface.co/docs/transformers/main/chat_templating) via the `apply_chat_template()` method. Here's an illustrative example:
|
182 |
|
183 |
```python
|
|
|
162 |
## Speeds, Sizes, Times
|
163 |
|
164 |
| runtime / 50 tokens (sec) | GPU | dtype | VRAM (GB) |
|
165 |
+
|:-----------------------------:|:---------------------:|:-------------:|:-----------------------:|
|
166 |
| 3.44 | 1x A100 (40 GB SXM) | torch.float16 | 16 |
|
167 |
|
168 |
## Training
|
|
|
177 |
tokenizer.chat_template = "{{ bos_token }}{% for message in messages %}{% if (message['role'] == 'user') != (loop.index0 % 2 == 0) %}{{ raise_exception('Conversation roles must alternate user/assistant/user/assistant/...') }}{% endif %}{% if message['role'] == 'user' %}{{ '[INST] ' + message['content'] + ' [/INST] ' }}{% elif message['role'] == 'assistant' %}{{ message['content'] + eos_token + ' ' }}{% else %}{{ raise_exception('Only user and assistant roles are supported!') }}{% endif %}{% endfor %}"
|
178 |
```
|
179 |
|
|
|
180 |
This format is available as a [chat template](https://huggingface.co/docs/transformers/main/chat_templating) via the `apply_chat_template()` method. Here's an illustrative example:
|
181 |
|
182 |
```python
|