While it seems elementary enough, it should be noted that at the time, the modern definitions didn't exist, and when Cayley introduced what are now called groups it wasn't immediately clear that this was equivalent to the previously known groups, which are now called permutation groups.
The theorem was later published by Walther Dyck in 1882[REF] and is attributed to Dyck in the first edition of Burnside's book [REF].