Separate Signal Values from Noise
I would use the SVD (Singular Value Decomposition).
By looking at the Singular Values I'd determine which vectors spread the data and which spread the noise.

Practically, they both do both, but if we speak which are dominant, this would be a great starting point.