1. A white list inside or outside determining apparatus comprising: a first feature data extracting unit which extracts first feature data from an image by using a first transformation formula created based on a plurality of preliminary learning images; a second feature data extracting unit which extracts second feature data from an image by using a second transformation formula created from the preliminary learning images and a plurality of application learning images; a first matching unit which performs matching between a registration image and a collation image by using the first transformation formula; and a second matching unit which performs matching between a registration image and a collation image by using the second transformation formula, wherein weights of a matching result of the first matching unit and a matching result of the second matching unit are changed according to the number of preliminary learning images and the number of application learning images.