Copy location constraint while maintaining the original distance
There are a lot of ways to achieve this, but the easiest and most straight forward would be to check Offset option in Copy Location constraint and move the Emp_toFollow back to it's original position. Like this: