An imaging flow cytometer device includes a housing holding a multi-color illumination source configured for pulsed or continuous wave operation. A microfluidic channel is disposed in the housing and is fluidically coupled to a source of fluid containing objects that flow through the microfluidic channel. A color image sensor is disposed adjacent to the microfluidic channel and receives light from the illumination source that passes through the microfluidic channel. The image sensor captures image frames containing raw hologram images of the moving objects passing through the microfluidic channel. The image frames are subject to image processing to reconstruct phase and/or intensity images of the moving objects for each color. The reconstructed phase and/or intensity images are then input to a trained deep neural network that outputs a phase recovered image of the moving objects. The trained deep neural network may also be trained to classify object types.