A self adapting cognitive-neural method and system for image analysis is disclosed. The method comprises detecting a set of potential items of interest in an image using a cognitive algorithm, refining the set of potential items of interest using a neural analysis, and adapting the cognitive algorithm based on information gained from the results of the neural analysis. The method may further comprise fusing the results of the cognitive and neural algorithms with a fusion classifier. The neural analysis can include eye tracked EEG, RSVP, or presentation to an operator for visual inspection.