mwitiderrick commited on
Commit
e788988
·
1 Parent(s): 6099b48

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +21 -0
README.md CHANGED
@@ -1,7 +1,20 @@
1
  ---
 
 
 
 
 
 
 
 
2
  tags:
3
  - deepsparse
4
  ---
 
 
 
 
 
5
  ## Usage
6
 
7
  ```python
@@ -75,6 +88,14 @@ There are many factors to consider when choosing a university. Here are some tip
75
 
76
  5. Get involved with extracurricular activities: Universities often have many extracurricular activities, which can help you meet new people
77
  """
 
 
 
 
 
 
 
 
78
  ```
79
  ## One-shot and Export
80
 
 
1
  ---
2
+ base_model: TinyLlama/TinyLlama-1.1B-Chat-v0.4
3
+ inference: false
4
+ model_type: llama
5
+ prompt_template: |
6
+ <|im_start|>user\n
7
+ {prompt}<|im_end|>\n
8
+ <|im_start|>assistant\n
9
+ quantized_by: mwitiderrick
10
  tags:
11
  - deepsparse
12
  ---
13
+ ## TinyLlama Chat 0.4- DeepSparse
14
+ This repo contains model files for [TinyLlama 1.1B Chat](https://huggingface.co/TinyLlama/TinyLlama-1.1B-Chat-v0.4) optimized for [DeepSparse](https://github.com/neuralmagic/deepsparse), a CPU inference runtime for sparse models.
15
+
16
+ This model was quantized and pruned with [SparseGPT](https://arxiv.org/abs/2301.00774), using [SparseML](https://github.com/neuralmagic/sparseml).
17
+
18
  ## Usage
19
 
20
  ```python
 
88
 
89
  5. Get involved with extracurricular activities: Universities often have many extracurricular activities, which can help you meet new people
90
  """
91
+ ```
92
+ ## Prompt template
93
+
94
+ ```
95
+ <|im_start|>user\n
96
+ {prompt}<|im_end|>\n
97
+ <|im_start|>assistant\n
98
+
99
  ```
100
  ## One-shot and Export
101