Hugging Face's logo

nm-testing
/
TinyLlama-1.1B-Chat-v0.4-pruned60-quant

Text Generation
Transformers
ONNX
llama
deepsparse
Model card Files Community
mwitiderrick commited on
Commit
8f028a5
·
1 Parent(s): 4c4c31f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +0 -1
README.md CHANGED
@@ -35,7 +35,6 @@ generation_config = {
35
  }
36
  prompt = "How to get in a good university?"
37
  formatted_prompt = f"<|im_start|>user\n{prompt}<|im_end|>\n<|im_start|>assistant\n"
38
-
39
  model = TextGeneration(model="hf:nm-testing/TinyLlama-1.1B-Chat-v0.4-pruned60-quant")
40
  print(model(formatted_prompt, generation_config=generation_config,).generations[0].text)
41
  """
 
35
  }
36
  prompt = "How to get in a good university?"
37
  formatted_prompt = f"<|im_start|>user\n{prompt}<|im_end|>\n<|im_start|>assistant\n"
 
38
  model = TextGeneration(model="hf:nm-testing/TinyLlama-1.1B-Chat-v0.4-pruned60-quant")
39
  print(model(formatted_prompt, generation_config=generation_config,).generations[0].text)
40
  """