The lenses of the prism spectrometer are used for both collimation and re-imaging; however, the imaging spectrometer is limited in its performance by the image quality provided by the collimators and re-imagers.
The refracting lenses used in the imaging spectrometer limit performance by the axial chromatic aberrations of the lens.