lukeyourheart commited on
Commit
3bf7f1c
·
verified ·
1 Parent(s): 91e6aae

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +45 -0
README.md ADDED
@@ -0,0 +1,45 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: lukeyourheart/distilgpt2-openvino
3
+ datasets:
4
+ - openwebtext
5
+ language: en
6
+ license: apache-2.0
7
+ pipeline_tag: text-generation
8
+ tags:
9
+ - exbert
10
+ - openvino
11
+ - openvino-export
12
+ - nncf
13
+ - 8-bit
14
+ co2_eq_emissions: 149200
15
+ model-index:
16
+ - name: distilgpt2
17
+ results:
18
+ - task:
19
+ type: text-generation
20
+ name: Text Generation
21
+ dataset:
22
+ name: WikiText-103
23
+ type: wikitext
24
+ metrics:
25
+ - type: perplexity
26
+ value: 21.1
27
+ name: Perplexity
28
+ ---
29
+
30
+ This model is a quantized version of [`lukeyourheart/distilgpt2-openvino`](https://huggingface.co/lukeyourheart/distilgpt2-openvino) and is converted to the OpenVINO format. This model was obtained via the [nncf-quantization](https://huggingface.co/spaces/echarlaix/nncf-quantization) space with [optimum-intel](https://github.com/huggingface/optimum-intel).
31
+
32
+ First make sure you have `optimum-intel` installed:
33
+
34
+ ```bash
35
+ pip install optimum[openvino]
36
+ ```
37
+
38
+ To load your model you can do as follows:
39
+
40
+ ```python
41
+ from optimum.intel import OVModelForCausalLM
42
+
43
+ model_id = "lukeyourheart/distilgpt2-openvino-8bit"
44
+ model = OVModelForCausalLM.from_pretrained(model_id)
45
+ ```