Additionally, as mentioned before, we observed that the loss used by GPT-3.5 Turbo was a poor indication of final model performance. This is particularly problematic as the model parameters are updated based on the loss gradient, potentially even moving away from better model parameters during finetuning. While it still provided us with the best base model that permits finetuning, open-source models would provide more insight regarding the loss, and even enabled us to modify it.