A white list inside or outside determining apparatus includes: a first feature data extracting unit which extracts first feature data from an image by using a first transformation formula created based on preliminary learning images; a second feature data extracting unit which extracts second feature data from an image by using a second transformation formula created from the preliminary learning images and application learning images; a first matching unit which performs matching between a registration image and a collation image by using the first transformation formula; and a second matching unit which performs matching between a registration image and a collation image by using the second transformation formula. Weights of a matching result of the first matching unit and a matching result of the second matching unit are changed according to the number of preliminary learning images and the number of application learning images.