Athspi commited on
Commit
8012672
·
verified ·
1 Parent(s): 5e221e2

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +30 -3
README.md CHANGED
@@ -1,8 +1,35 @@
1
  ---
2
  license: apache-2.0
3
  tags:
 
4
  - storytelling
5
  - fiction
6
- language:
7
- - en
8
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: apache-2.0
3
  tags:
4
+ - generated_from_trainer
5
  - storytelling
6
  - fiction
7
+ - tiny-stories
8
+ pipeline_tag: text-generation
9
+ ---
10
+
11
+ # Athspi LLM
12
+
13
+ 🧠 A small but capable language model for creative story generation, trained on the TinyStories dataset.
14
+
15
+ ![Athspi Banner](https://example.com/banner.jpg) <!-- Add your banner image URL -->
16
+
17
+ ## Model Details
18
+
19
+ ### Architecture
20
+ - **Model Type**: Transformer-based language model
21
+ - **Layers**: 4
22
+ - **Embedding Dim**: 384
23
+ - **Heads**: 6
24
+ - **Sequence Length**: 128 tokens
25
+ - **Parameters**: ~28M
26
+
27
+ ### Training Data
28
+ - **Dataset**: [TinyStories](https://huggingface.co/datasets/roneneldan/TinyStories)
29
+ - **Training Coverage**: 5% of dataset (~100k samples)
30
+
31
+ ## Usage
32
+
33
+ ### Installation
34
+ ```bash
35
+ pip install torch transformers sentencepiece