Apple TV, xfinity, and remote app
Although I can't say for sure, my "gut feeling" is that this is a firewall issue - your router could be blocking ports 3689 and/or 5353.

See also: If the Remote app won't connect