mwitiderrick commited on
Commit
4c4c31f
·
1 Parent(s): 3759066

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +0 -3
README.md CHANGED
@@ -28,18 +28,15 @@ There are several factors to consider when choosing a university:
28
 
29
  ```python
30
  from deepsparse import TextGeneration
31
-
32
  generation_config = {
33
  "repetition_penalty": 1.1,
34
  "do_sample": True,
35
  "max_new_tokens": 500,
36
  }
37
-
38
  prompt = "How to get in a good university?"
39
  formatted_prompt = f"<|im_start|>user\n{prompt}<|im_end|>\n<|im_start|>assistant\n"
40
 
41
  model = TextGeneration(model="hf:nm-testing/TinyLlama-1.1B-Chat-v0.4-pruned60-quant")
42
-
43
  print(model(formatted_prompt, generation_config=generation_config,).generations[0].text)
44
  """
45
  The university is one of the best options for students. It provides the right atmosphere for studying. The
 
28
 
29
  ```python
30
  from deepsparse import TextGeneration
 
31
  generation_config = {
32
  "repetition_penalty": 1.1,
33
  "do_sample": True,
34
  "max_new_tokens": 500,
35
  }
 
36
  prompt = "How to get in a good university?"
37
  formatted_prompt = f"<|im_start|>user\n{prompt}<|im_end|>\n<|im_start|>assistant\n"
38
 
39
  model = TextGeneration(model="hf:nm-testing/TinyLlama-1.1B-Chat-v0.4-pruned60-quant")
 
40
  print(model(formatted_prompt, generation_config=generation_config,).generations[0].text)
41
  """
42
  The university is one of the best options for students. It provides the right atmosphere for studying. The