text: ***1. Introduction***1 
  
  While the ﬁeld of artiﬁcial intelligence research and technology has a long history, broad 
  public attention grew over the last year in light of the wide availability of new generative AI 
  systems, including large language models (LLMs) like GPT-4, Claude, and LLaMA-2. These 
  tools are developed using machine learning and other techniques that analyze large datasets 
  of written text, and they are capable of generating text in response to a user’s prompts. 
  
  While many large language models rely on website text for training, books have also played 
  an important role in developing and improving AI systems. Despite the widespread use of e- 
  books and growth of sales in that market, books remain diﬃcult for researchers and 
  entrepreneurs to access at scale in digital form for the purposes of training AI. 
  
  In 2023, multiple news publications reported on the availability and use of a dataset of books 
   The Books3 dataset contains text from over 170,000 books, 
  called “Books3” to train LLMs. 
  which are a mix of in-copyright and out-of-copyright works. It is believed to have been 
  originally sourced from a website that was not authorized to distribute all of the works 
  contained in the dataset. In lawsuits brought against OpenAI, Microsoft, Meta, and 
  Bloomberg related to their LLMs, the use of Books3 as training data was speciﬁcally cited. 3 
  
  2 