We find that the GPT-3.5 Turbo base model performed poorly in ORCA input file synthesis, producing few functional files and struggling with accurate synthesis of settings and options. The relatively respectable F1 keywords score is likely because the key-Fig. Validation performance of all models using RAG as a function of retrieved documentation pages (K).