We utilized LoRA's architecture for our adapters, which captures task-specific patterns by reducing the transformer's hidden representations to a much lower dimension and then projecting them back to the original dimension. During the fine-tuning process, we trained the adapters with a batch size of 8 and for 60 epochs. Evaluation metrics for generative molecules. Drug-likeness refers to the properties of a molecule that make it suitable for use as a pharmaceutical drug. This includes factors such as bioavailability, stability, and the ability to interact with biological targets effectively. To quantify drug-likeness, we used the quantitative estimate of drug-likeness (QED) as an evaluation metric . The QED score, which ranges from 0 to 1, provides a numerical assessment of a molecule's drug-like qualities, with higher scores indicating a greater likelihood of the molecule being suitable for drug development. This metric is widely accepted for its ability to combine multiple drug-like properties into a single, easy-tointerpret score.