The invention relates to a system for detecting objects in a digital image. The system comprises a neural network which is configured to generate candidate windows indicating object locations, and to generate for each candidate window a score representing the confidence of detection. Generating the scores comprises:



generating a latent representation for each candidate window,
updating the latent representation of each candidate window based on the latent representation of neighboring candidate windows, and
generating the score for each candidate window based on its updated latent representation




The invention further relates to a system for rescoring object detections in a digital image and to methods of detecting objects and rescoring objects.