Our experiments show that not all alignment optimisations are effective in the minimal training setting. Both DPO and KTO show zero performance in caption generation when models are initialised with crossmodal weights unrelated to the task (see Table ). However, performance improves significantly when the crossmodals are known (see Table ). In molecule generation, DPO achieves up to 42% better performance than Meditron, trained on the full dataset, while KTO still performs poorly, likely due to overfitting (see Appx. F).