Unpair apple remote from Apple TV
Pair is actually a bit of a misnomer.   Unpaired remotes will still control the device.   Pairing only changes the receiver so that it just looks for the paired remote.  In "un -Paired" any remote can control the device.

If you have multiple devices that you do not want to interfere with each other pair them to their own remotes and they will not interfere.   If one device is left unpaired it will still follow signals from other remote.