Update README.md

README.md

@@ -1,31 +1,29 @@
----
-base_model:
-- meta-llama/Meta-Llama-3-8B-Instruct
-library_name: transformers
-tags:
-- mergekit
-- merge
+# Aura-llama
 
----
-# merge
+![image/webp](https://cdn-uploads.huggingface.co/production/uploads/64545af5ec40bbbd01242ca6/QYpWMEXTe0_X3A7HyeBm0.webp)
+Now that the cute anime girl has your attention.
 
-This is a merge of pre-trained language models created using [mergekit](https://github.com/cg123/mergekit).
+Aura-llama is using the methodology presented by SOLAR for scaling LLMs called depth up-scaling (DUS), which encompasses architectural modifications with continued pretraining. 
+Using the solar paper as a base, I integrated Llama-3 weights into the upscaled layers, and In the future plan to continue training the model.
 
-## Merge Details
-### Merge Method
 
-This model was merged using the passthrough merge method.
-
-### Models Merged
-
-The following models were included in the merge:
+Aura-llama is a merge of the following models to create a base model to work from:
+* [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct)
 * [meta-llama/Meta-Llama-3-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3-8B-Instruct)
 
-### Configuration
+## Merged Evals: (Has Not Been Finetuned)
+Aura-llama
+* Avg: ?
+* ARC: ?
+* HellaSwag: ?
+* MMLU: ?
+* T-QA: ?
+* Winogrande: ?
+* GSM8K: ?
 
-The following YAML configuration was used to produce this model:
+## 🧩 Configuration
 
-```yaml
+```
 slices:
   - sources:
     - model: meta-llama/Meta-Llama-3-8B-Instruct
@@ -35,4 +33,4 @@ slices:
       layer_range: [7, 31]
 merge_method: passthrough
 dtype: bfloat16
-```
+```