crumb commited on
Commit
536b988
·
1 Parent(s): 4b390b4

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -0
README.md ADDED
@@ -0,0 +1 @@
 
 
1
+ The smallest GPT-2 finetuned on approximately 2.23B tokens consisting of 1.3B from common crawl sites from 2023, 540M from ArXiv, and 390M from GitHub.