Daemontatox commited on
Commit
eafbd79
·
verified ·
1 Parent(s): a10d6f6

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +115 -8
README.md CHANGED
@@ -1,22 +1,129 @@
1
  ---
2
- base_model: meta-llama/Llama-3.1-8B-Instruct
 
3
  tags:
4
  - text-generation-inference
5
  - transformers
6
  - unsloth
7
- - llama
8
  - trl
 
 
9
  license: apache-2.0
10
  language:
11
  - en
 
 
 
 
 
 
 
 
 
12
  ---
13
 
14
- # Uploaded model
15
 
16
- - **Developed by:** Daemontatox
17
- - **License:** apache-2.0
18
- - **Finetuned from model :** meta-llama/Llama-3.1-8B-Instruct
19
 
20
- This llama model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
 
 
21
 
22
- [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ base_model:
3
+ - Meta/LLama3.1-8B-Instruct
4
  tags:
5
  - text-generation-inference
6
  - transformers
7
  - unsloth
8
+ - Llama3
9
  - trl
10
+ - COT
11
+ - Reasoning
12
  license: apache-2.0
13
  language:
14
  - en
15
+ datasets:
16
+ - Daemontatox/LongCOT-Reason
17
+ metrics:
18
+ - accuracy
19
+ - character
20
+ - competition_math
21
+ - code_eval
22
+ library_name: transformers
23
+ new_version: Daemontatox/AetherLlama
24
  ---
25
 
26
+ ![image](./image.webp)
27
 
28
+ # AetherLlama
 
 
29
 
30
+ - **Developed by:** Daemontatox
31
+ - **License:** Apache 2.0
32
+ - **Finetuned Using:** [Unsloth](https://github.com/unslothai/unsloth), Hugging Face Transformers, and TRL Library
33
 
34
+ ## Model Overview
35
+
36
+ The ** AetherLlama Model** is an advanced AI system optimized for logical reasoning, multi-step problem-solving, and decision-making tasks. Designed with efficiency and accuracy in mind, it employs a structured system prompt to ensure high-quality answers through a transparent and iterative thought process.
37
+
38
+ ### System Prompt and Workflow
39
+
40
+ This model operates using an innovative reasoning framework structured around the following steps:
41
+
42
+ 1. **Initial Thought:**
43
+ The model uses `<Thinking>` tags to reason step-by-step and craft its best possible response.
44
+ Example:
45
+
46
+ 2. **Self-Critique:**
47
+ It evaluates its initial response within `<Critique>` tags, focusing on:
48
+ - **Accuracy:** Is it factually correct and verifiable?
49
+ - **Clarity:** Is it clear and free of ambiguity?
50
+ - **Completeness:** Does it fully address the request?
51
+ - **Improvement:** What can be enhanced?
52
+ Example:
53
+
54
+ 3. **Revision:**
55
+ Based on the critique, the model refines its response within `<Revising>` tags.
56
+ Example:
57
+
58
+ 4. **Final Response:**
59
+ The revised response is presented clearly within `<Final>` tags.
60
+ Example:
61
+
62
+ 5. **Tag Innovation:**
63
+ When needed, the model creates and defines new tags for better structuring or clarity, ensuring consistent usage.
64
+ Example:
65
+
66
+ ### Key Features
67
+ - **Structured Reasoning:** Transparent, multi-step approach for generating and refining answers.
68
+ - **Self-Improvement:** Built-in critique and revision ensure continuous response enhancement.
69
+ - **Clarity and Adaptability:** Tagging system provides organized, adaptable responses tailored to user needs.
70
+ - **Creative Flexibility:** Supports dynamic problem-solving with the ability to introduce new tags and concepts.
71
+
72
+ ---
73
+
74
+ ## Use Cases
75
+
76
+ The model is designed for various domains, including:
77
+ 1. **Research and Analysis:** Extracting insights and providing structured explanations.
78
+ 2. **Education:** Assisting with tutoring by breaking down complex problems step-by-step.
79
+ 3. **Problem-Solving:** Offering logical and actionable solutions for multi-step challenges.
80
+ 4. **Content Generation:** Producing clear, well-organized creative or professional content.
81
+
82
+ ---
83
+
84
+ ## Training Details
85
+
86
+ - **Frameworks:**
87
+ - [Unsloth](https://github.com/unslothai/unsloth) for accelerated training.
88
+ - Hugging Face Transformers and the TRL library for reinforcement learning with human feedback (RLHF).
89
+
90
+ - **Dataset:** Finetuned on diverse reasoning-focused tasks, including logical puzzles, mathematical problems, and commonsense reasoning scenarios.
91
+
92
+ - **Hardware Efficiency:**
93
+ - Trained with bnb-4bit precision for reduced memory usage.
94
+ - Optimized training pipeline achieving 2x faster development cycles.
95
+
96
+ ---
97
+
98
+ ## Performance Metrics
99
+
100
+ The model excels in reasoning benchmarks:
101
+ - **ARC (AI2 Reasoning Challenge):** High accuracy in logical and commonsense tasks.
102
+ - **GSM8K (Math Reasoning):** Superior results in multi-step problem-solving.
103
+ - **CommonsenseQA:** Strong comprehension of everyday reasoning tasks.
104
+
105
+ ---
106
+
107
+ ## Ethical Considerations
108
+
109
+ - **Transparency:** Responses are structured for verifiability through tagging.
110
+ - **Bias Mitigation:** Includes self-critique to minimize biases and ensure fairness.
111
+ - **Safe Deployment:** Users are encouraged to evaluate outputs to prevent harm or misinformation.
112
+
113
+ ---
114
+
115
+ ## License
116
+
117
+ This model is distributed under the Apache 2.0 license, allowing users to use, modify, and share it in compliance with the license terms.
118
+
119
+ ---
120
+
121
+ ## Acknowledgments
122
+
123
+ Special thanks to:
124
+ - [Unsloth](https://github.com/unslothai/unsloth) for accelerated training workflows.
125
+ - Hugging Face for their powerful tools and libraries.
126
+
127
+ ---
128
+
129
+ Experience the **AetherLlama l**, leveraging its structured reasoning and self-improvement capabilities for any task requiring advanced AI reasoning.