summaries that outperform standard physician documentation in completeness and error
frequency.35 However, factual inconsistencies in the summaries produced by LLMs increase as the
context length increases,36 and for medium- to long-context tasks, fine-tuning an open-source
model has been shown to perform better than a prompt-learning approach.37 In prior work,
members of this study team demonstrated 62% of LLM-generated hospital course summaries met
standard-of-care for a formal inpatient discharge summary.24 However,recently published clinical
JAMA Network Open |Emergency Medicine Developing and Evaluating LLM-Generated Emergency Medicine Handoff Notes
JAMA Network Open.2024;7(12):e2448723. doi:10.1001/jamanetworkopen.2024.48723 (Reprinted) December 3, 2024 2/12
Downloaded from jamanetwork.com by guest on 01/13/2025