• Energy calculation did not converge. We can penalize an action if the new structure does not have a valid energy, i.e. the energy calculation did not converge. In this case, the performed action did not give any valuable information, the new structure cannot be accepted and the reward as the energy drop cannot be calculated. Penalizing actions for non-converged structures helps to reveal the less successful actions for the given composition and thus decrease their usage. • Zero-reward. We can penalize an action if the new structure has the same energy as the current structure. It is worth noting that, in general, such zero reward actions are not as undesirable as those generating non-converged new structures, because we still have a valid structure which can accepted. However, the zero-energy difference between the structures hinders the efficient energy landscape exploration. • Non-unique energy structure. We can penalize actions that visit structures with nonunique energies, to disfavour actions that tend to produce structures with energies that have been previously observed in the current run.