Herein, we trained several GemNet potentials on different subsets of the recently published QM7-x database. This dataset consists of around 4.2 million configurations sampled from small organic molecules consisting of up to seven non-hydrogen atoms (i.e. C, O, N, S, Cl), with 4-23 atoms in total. Importantly, QM7-x covers both equilibrium and non-equilibrium structures. Starting from 6,950 structural formulas, it contains around 41,500 equilibrium structures (including stereoisomers and conformers) and 100 additional non-equilibrium structures for each equilibrium geometry. The latter were generated by applying linear combinations of normal mode displacements to each configurations, thus approximately mimicking molecular dynamics within the harmonic approximation. For each configuration, total energies and forces at the hybrid DFT (PBE0) level with a many-body dispersion correction (MBD) are provided, computed with tightly converged numerical atom-centered basis sets and integration grids (see Ref. [36] for full details).