1. A surface defect data display and management system having a data processing apparatus, a storage and a display apparatus and adapted to display, on the display apparatus, surface defect data concerning a surface defect on a substrate detected by a surface defect inspection system for inspecting the surface defect on the substrate, wherein said storage includes a defect data memory unit for storing, as the surface defect data, data containing position, feature factor, defect classification name and defect image of the surface defect detected by said surface defect inspection system, and a design data memory unit for storing design data representative of the shape of a pattern formed on the surface of said substrate, and wherein said data processing apparatus comprises: a risk score calculation unit for calculating, in respect of individual surface defects indicated by the surface defect data stored in said defect data memory unit, the magnitude of an influence the surface defect has upon a reduction in the yield of a final product manufactured from the substrate as a risk score of the surface defect on the basis of the feature factors and a pattern concentration obtained from design data of a pattern figure nearby a location position corresponding to the position of the surface defect; a correlation graph display unit for preparing, in respect of the surface defects indicated by said surface defect data stored in said defect data memory unit, a correlation graph showing the correlation between the feature factors and the calculated risk scores of the individual surface defects in the form of positions of dots and displaying the prepared correlation graph on said display apparatus; a surface defect selection unit for selecting one or more surface defects on the basis of dots indicative of the surface defects shown in said correlation graph; and a surface defect image display unit for displaying in respect of one or more selected surface defects a list of surface defects on said display apparatus.