In protected deletion, the removal of tokens identifying ring structures (numbers from '1' to '9', and '%'), and branches ('(' and ')') was not allowed. • Atom Masking. After transforming the SMILES strings into an RDKit molecular object, each atom was masked with a probability p using the dummy atom '*'. For functional group masking, SMARTS patterns were used to identify substructures to mask.