Object B's position to Object A as a controller for object A's animation
If I correctly understood what you want, you could do it with a Track To constraint: Give your object A an armature, and give the bone that is supposed to move according to object B a Track To constraint, with the Camera as the Target. Now when your Camera moves, the bone will follow.