An apparatus for detecting surface characteristics on food objects conveyed by a conveyor has a first imaging device for capturing two-dimensional image data (2D) and a second imaging device for capturing three-dimensional image data (3D) of a food object. A image processing unit is configured to utilize either the 2D or 3D image data in determining whether a potential defect is present on the surface of the food object. The image processing unit determines a surface position of a potential defect, and utilizes the 2D or 3D image data in determining whether an actual defect is present on the surface of the food object at the indicated surface position. The apparatus has an output unit for outputting defect related data in case both of the 2D and the 3D image data indicate that an actual defect is present on the surface of the food object at the indicated surface position.