Hugging Face's logo

Lambent
/
Falcon3-Continued-0.3-10B-Base

Safetensors
llama
Model card Files Community
Lambent commited on
Commit
a824f1e
·
verified ·
1 Parent(s): df72c74

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -0
README.md CHANGED
@@ -8,6 +8,8 @@ base_model:
8
  - tiiuae/Falcon3-10B-Base
9
  ---
10
 
 
 
11
  This model uses qLoRA with UnSloth to continuously pretrain Falcon3-10B-Base on an additional 30,720 rows from PleIAs/common_corpus, cyclically.
12
 
13
  Rows trained at a time varied between 2048, 4096, and 8192, using cosine decay. A merged model was saved and tested every 10240 rows.
 
8
  - tiiuae/Falcon3-10B-Base
9
  ---
10
 
11
+ *Falcon3-Continued-0.3-10B-Base is built using artificial intelligence technology from the Technology Innovation Institute.*
12
+
13
  This model uses qLoRA with UnSloth to continuously pretrain Falcon3-10B-Base on an additional 30,720 rows from PleIAs/common_corpus, cyclically.
14
 
15
  Rows trained at a time varied between 2048, 4096, and 8192, using cosine decay. A merged model was saved and tested every 10240 rows.