text: As the awareness about The Pile dataset grew, certain rightsholders began sending copyright 
  notices to have the dataset taken down from various websites. 
  
  Despite the takedown requests, the importance of books to EleutherAI and the broader 
  community’s AI research remained. In hoping to forge a path forward EleutherAI announced 
   29 
  in 2024 that they would create a new version of the dataset, which they will call The Pile v2. 
  Among other things, v2 would “have many more books than the original Pile had, for 
  example, and more diverse representation of non-academic non-ﬁction domains.” At the 
  same time, it would only seek to include public domain books and permissively licensed 
  content. As before, this corpus focuses on English language books. 