Conversion between primary colours
Hint: I think you want to determine the [Rx,Ry,Rz] required to make the left side of your equation look like [1 0 0], [0 1 0], and [0 0 1]. This will get you A,B,C expressed in terms of X,Y,Z.