An inspection system with radiation-induced false count mitigation includes an illumination source configured to illuminate a sample, a detector assembly comprising an illumination sensor configured to detect illumination from the sample, and one or more radiation sensors configured to detect particle radiation, and control circuitry communicatively coupled to the detector. The control circuitry is configured to perform the steps of determining a set of radiation detection events based on one or more radiation signals received from the radiation sensors, determining a set of imaging events based on the illumination signal received from the illumination sensor, comparing the set of radiation detection events to the set of imaging events to generate a set of coincidence events, wherein the set of coincidence events comprises simultaneous imaging and radiation detection events, and excluding the set of coincidence events from the set of imaging events to generate a set of identified defect sites.