The datasets used in this study are a subset of peptides from the Uniprot databaseBateman , composed of 268,195 short peptide sequences with a maximum sequence length of 50 residues, combined with a set of 35,806 sequences from the StarPep database, which features short bio-active peptidesPinacho-Castellanos et al. . We restrict our training set to sequences of lengths 2-50 amino acids because a significant majority of AMPs are short peptides with length < 50, and 85% of the peptides featured in StarPep are between 2 and 50 amino acids longRamazi et al. . Preliminary testing demonstrated that retaining peptides up to 100 amino acids in length led to worse performance, presumably due to the heightened sparsification of the dataset in that regime.