The effectiveness of the 10 Paper Summary was in part limited to the quality of material from each of the 10 papers in regards to paclitaxel biosynthesis. Papers provided to o1-preview were limited to the main body of text without references, due to lack of PDF document retrieval functionality and input token limitations. ChatGPT-4o currently cites context window limitations as 8K or 32K, which may affect the ability to read some portions of the longer papers in full. The o1-preview model is unique as it combines advanced Chain of Thought reasoning with longer outputs, but did not prove to be consistently better than other top models based on judge scores. However, performance may be higher than expected due to the ScholarGPT Judge sharing more similarities and bias more towards ChatGPT-4o than o1-preview. Higher OpenAI model scores also typically corresponded to high quality generations based on the manuscript author's observations. Judge ScholarGPT was suitable in a prior manuscript to evaluate spectral chemistry image responses , as well as answering questions regarding other aspects of chemical research . Although AI model similarities exist between ChatGPT-4o and ScholarGPT, ChatGPT-4o has also scored well using a human judge , and both Llama 3.1 405B and Nemotron 4 340B judges from different software manufacturers concurred on ChatGPT-4o performance .