The second rule of Elf on the Shelf is that the elf will not speak or move while the kids are awake. The elf only moves at night when it makes its trip back to the North Pole. Once it returns home, it then assumes a new position in the house.