Replace texture coordinate "Reflection"
Not sure I totally understand the issue or if I recreated your setup correctly, but the Vector Transform node seems to be the correct answer.

If you transform from World to Local coordinates it seems to fix the issue of a moving eye.



The Gradient Ramp might need some adjustments afterwards