For a given exposure, for example for a fixed focal-plane illuminance and exposure time, larger image sensors capture more photons and hence produce images with less image noise and greater dynamic range than smaller sensors.
Since crop factor is inversely proportional to the square root of sensor area (to within a small aspect ratio-dependent factor), it is useful for estimating image sensor performance.