apepkuss79 commited on
Commit
b660c84
·
verified ·
1 Parent(s): c04a10d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +38 -3
README.md CHANGED
@@ -1,3 +1,38 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: Qwen/Qwen2.5-14B-Instruct-1M-1M
3
+ license: apache-2.0
4
+ license_link: https://huggingface.co/Qwen/Qwen2.5-14B-Instruct-1M-1M/blob/main/LICENSE
5
+ model_creator: Qwen
6
+ model_name: Qwen2.5-14B-Instruct-1M
7
+ quantized_by: Second State Inc.
8
+ language:
9
+ - en
10
+ pipeline_tag: text-generation
11
+ tags:
12
+ - chat
13
+ library_name: transformers
14
+ ---
15
+
16
+ # Qwen2.5-14B-Instruct-1M-GGUF
17
+
18
+ ## Original Model
19
+
20
+ [Qwen/Qwen2.5-14B-Instruct-1M](https://huggingface.co/Qwen/Qwen2.5-14B-Instruct-1M)
21
+
22
+ ## Run with Gaianet
23
+
24
+ **Prompt template**
25
+
26
+ prompt template: `chatml`
27
+
28
+ **Context size**
29
+
30
+ chat_ctx_size: `1010000`
31
+
32
+ **Run with GaiaNet**
33
+
34
+ - Quick start: https://docs.gaianet.ai/node-guide/quick-start
35
+
36
+ - Customize your node: https://docs.gaianet.ai/node-guide/customize
37
+
38
+ *Quantized with llama.cpp b3751*