公开(公告)号：US11054357B2

公开(公告)日：2021-07-06

申请号：US16492098

申请日：2018-03-09

Applicant: THE REGENTS OF THE UNIVERSITY OF CALIFORNIA

Inventor： Aydogan Ozcan ,  Yichen Wu ,  Steve Wei Feng

IPC: G01N15/00 ,  G01N15/02 ,  G01N15/06 ,  G01N15/14

Abstract: A lens-free microscope for monitoring air quality includes a housing that contains a vacuum pump configured to draw air into an impaction nozzle. The impaction nozzle has an output located adjacent to an optically transparent substrate for collecting particles. One or more illumination sources are disposed in the housing and are configured to illuminate the collected particles on the optically transparent substrate. An image sensor is located adjacent to the optically transparent substrate, wherein the image sensor collects particle diffraction patterns or holographic images cast upon the image sensor. At least one processor is disposed in the housing and controls the vacuum pump and the one or more illumination sources. Image files are transferred to a separate computing device for image processing using machine learning to identify particles and perform data analysis to output particle images, particle size, particle density, and/or particle type data.

公开(公告)号：US20190286053A1

公开(公告)日：2019-09-19

申请号：US16300546

申请日：2017-05-10

Applicant: THE REGENTS OF THE UNIVERSITY OF CALIFORNIA

Inventor： Aydogan Ozcan ,  Yichen Wu ,  Yibo Zhang ,  Wei Luo

IPC: G03H1/04 ,  G03H1/22 ,  G03H1/00 ,  H04N9/04 ,  G06T3/40 ,  H04N5/232 ,  H04N9/68 ,  H04N9/73

Abstract: A method of generating a color image of a sample includes obtaining a plurality of low resolution holographic images of the sample using a color image sensor, the sample illuminated simultaneously by light from three or more distinct colors, wherein the illuminated sample casts sample holograms on the image sensor and wherein the plurality of low resolution holographic images are obtained by relative x, y, and z directional shifts between sample holograms and the image sensor. Pixel super-resolved holograms of the sample are generated at each of the three or more distinct colors. De-multiplexed holograms are generated from the pixel super-resolved holograms. Phase information is retrieved from the de-multiplexed holograms using a phase retrieval algorithm to obtain complex holograms. The complex hologram for the three or more distinct colors is digitally combined and back-propagated to a sample plane to generate the color image.

公开(公告)号：US20200340901A1

公开(公告)日：2020-10-29

申请号：US16858444

申请日：2020-04-24

Applicant: THE REGENTS OF THE UNIVERSITY OF CALIFORNIA

Inventor： Aydogan Ozcan ,  Yichen Wu

IPC: G01N15/02 ,  G03H1/22 ,  G03H1/04 ,  G06T7/00

Abstract: A label-free bio-aerosol sensing platform and method uses a field-portable and cost-effective device based on holographic microscopy and deep-learning, which screens bio-aerosols at a high throughput level. Two different deep neural networks are utilized to rapidly reconstruct the amplitude and phase images of the captured bio-aerosols, and to output particle information for each bio-aerosol that is imaged. This includes, a classification of the type or species of the particle, particle size, particle shape, particle thickness, or spatial feature(s) of the particle. The platform was validated using the label-free sensing of common bio-aerosol types, e.g., Bermuda grass pollen, oak tree pollen, ragweed pollen, Aspergillus spore, and Alternaria spore and achieved >94% classification accuracy. The label-free bio-aerosol platform, with its mobility and cost-effectiveness, will find several applications in indoor and outdoor air quality monitoring.

公开(公告)号：US10795315B2

公开(公告)日：2020-10-06

申请号：US16300546

申请日：2017-05-10

Applicant: THE REGENTS OF THE UNIVERSITY OF CALIFORNIA

Inventor： Aydogan Ozcan ,  Yichen Wu ,  Yibo Zhang ,  Wei Luo

IPC: G06K9/76 ,  G03H1/04 ,  H04N9/04 ,  G03H1/00 ,  G03H1/22 ,  G06T3/40 ,  H04N5/232 ,  H04N9/68 ,  H04N9/73

Abstract: A method of generating a color image of a sample includes obtaining a plurality of low resolution holographic images of the sample using a color image sensor, the sample illuminated simultaneously by light from three or more distinct colors, wherein the illuminated sample casts sample holograms on the image sensor and wherein the plurality of low resolution holographic images are obtained by relative x, y, and z directional shifts between sample holograms and the image sensor. Pixel super-resolved holograms of the sample are generated at each of the three or more distinct colors. De-multiplexed holograms are generated from the pixel super-resolved holograms. Phase information is retrieved from the de-multiplexed holograms using a phase retrieval algorithm to obtain complex holograms. The complex hologram for the three or more distinct colors is digitally combined and back-propagated to a sample plane to generate the color image.

公开(公告)号：US12020165B2

公开(公告)日：2024-06-25

申请号：US17294384

申请日：2019-11-14

Applicant: THE REGENTS OF THE UNIVERSITY OF CALIFORNIA

Inventor： Aydogan Ozcan ,  Yair Rivenson ,  Yichen Wu

IPC: G06N3/084 ,  G02B21/00 ,  G02B21/36 ,  G03H1/00 ,  G03H1/26 ,  G06T5/70 ,  G06T7/50 ,  G06V10/764 ,  G06V10/82 ,  G06V20/69

CPC classification number: G06N3/084 ,  G02B21/0008 ,  G02B21/365 ,  G03H1/0005 ,  G03H1/268 ,  G06T5/70 ,  G06T7/50 ,  G06V10/764 ,  G06V10/82 ,  G06V20/69 ,  G03H2001/005 ,  G06T2207/10056 ,  G06T2207/10064 ,  G06T2207/20081 ,  G06T2207/20084

Abstract: A trained deep neural network transforms an image of a sample obtained with a holographic microscope to an image that substantially resembles a microscopy image obtained with a microscope having a different microscopy image modality. Examples of different imaging modalities include bright-field, fluorescence, and dark-field. For bright-field applications, deep learning brings bright-field microscopy contrast to holographic images of a sample, bridging the volumetric imaging capability of holography with the speckle-free and artifact-free image contrast of bright-field microscopy. Holographic microscopy images obtained with a holographic microscope are input into a trained deep neural network to perform cross-modality image transformation from a digitally back-propagated hologram corresponding to a particular depth within a sample volume into an image that substantially resembles a microscopy image of the sample obtained at the same particular depth with a microscope having the different microscopy image modality.

公开(公告)号：US20220012850A1

公开(公告)日：2022-01-13

申请号：US17294384

申请日：2019-11-14

Applicant: THE REGENTS OF THE UNIVERSITY OF CALIFORNIA

Inventor： Aydogan Ozcan ,  Yair Rivenson ,  Yichen Wu

IPC: G06T5/00 ,  G06T7/50 ,  G02B21/36 ,  G02B21/00 ,  G03H1/00 ,  G03H1/26

Abstract: A trained deep neural network transforms an image of a sample obtained with a holographic microscope to an image that substantially resembles a microscopy image obtained with a microscope having a different microscopy image modality. Examples of different imaging modalities include bright-field, fluorescence, and dark-field. For bright-field applications, deep learning brings bright-field microscopy contrast to holographic images of a sample, bridging the volumetric imaging capability of holography with the speckle-free and artifact-free image contrast of bright-field microscopy. Holographic microscopy images obtained with a holographic microscope are input into a trained deep neural network to perform cross-modality image transformation from a digitally back-propagated hologram corresponding to a particular depth within a sample volume into an image that substantially resembles a microscopy image of the sample obtained at the same particular depth with a microscope having the different microscopy image modality.

公开(公告)号：US20190294108A1

公开(公告)日：2019-09-26

申请号：US16359609

申请日：2019-03-20

Applicant: THE REGENTS OF THE UNIVERSITY OF CALIFORNIA

Inventor： Aydogan Ozcan ,  Yair Rivenson ,  Yichen Wu ,  Yibo Zhang ,  Harun Gunaydin

IPC: G03H1/22 ,  G03H1/04 ,  G06N3/08

Abstract: A method of performing phase retrieval and holographic image reconstruction of an imaged sample includes obtaining a single hologram intensity image of the sample using an imaging device. The single hologram intensity image is back-propagated to generate a real input image and an imaginary input image of the sample with image processing software, wherein the real input image and the imaginary input image contain twin-image and/or interference-related artifacts. A trained deep neural network is provided that is executed by the image processing software using one or more processors and configured to receive the real input image and the imaginary input image of the sample and generate an output real image and an output imaginary image in which the twin-image and/or interference-related artifacts are substantially suppressed or eliminated. In some embodiments, the trained deep neural network simultaneously achieves phase-recovery and auto-focusing significantly extending the DOF of holographic image reconstruction.

公开(公告)号：US11946854B2

公开(公告)日：2024-04-02

申请号：US17418782

申请日：2019-12-23

Applicant: THE REGENTS OF THE UNIVERSITY OF CALIFORNIA

Inventor： Aydogan Ozcan ,  Yair Rivenson ,  Yichen Wu

IPC: G01N15/14 ,  G01N21/64 ,  G06F18/214 ,  G06N3/08 ,  G06T3/40 ,  G06T3/4046 ,  G06T3/4053 ,  G06T5/00 ,  G06T5/50 ,  G06V10/44 ,  G06V10/77 ,  G06V10/82 ,  G06V20/69

CPC classification number: G01N15/1475 ,  G01N21/6458 ,  G06F18/214 ,  G06N3/08 ,  G06T3/4046 ,  G06T3/4053 ,  G06T5/003 ,  G06T5/50 ,  G06V10/454 ,  G06V10/7715 ,  G06V10/82 ,  G06V20/69 ,  G06T2207/10016 ,  G06T2207/10056 ,  G06T2207/10064 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/20221

Abstract: A fluorescence microscopy method includes a trained deep neural network. At least one 2D fluorescence microscopy image of a sample is input to the trained deep neural network, wherein the input image(s) is appended with a digital propagation matrix (DPM) that represents, pixel-by-pixel, an axial distance of a user-defined or automatically generated surface within the sample from a plane of the input image. The trained deep neural network outputs fluorescence output image(s) of the sample that is digitally propagated or refocused to the user-defined surface or automatically generated. The method and system cross-connects different imaging modalities, permitting 3D propagation of wide-field fluorescence image(s) to match confocal microscopy images at different sample planes. The method may be used to output a time sequence of images (e.g., time-lapse video) of a 2D or 3D surface within a sample.

公开(公告)号：US11514325B2

公开(公告)日：2022-11-29

申请号：US16359609

申请日：2019-03-20

Applicant: THE REGENTS OF THE UNIVERSITY OF CALIFORNIA

Inventor： Aydogan Ozcan ,  Yair Rivenson ,  Yichen Wu ,  Yibo Zhang ,  Harun Gunaydin

IPC: G06N3/08 ,  G06N3/02 ,  G03H1/22 ,  G03H1/04 ,  G06N3/067 ,  G03H1/00

Abstract: A method of performing phase retrieval and holographic image reconstruction of an imaged sample includes obtaining a single hologram intensity image of the sample using an imaging device. The single hologram intensity image is back-propagated to generate a real input image and an imaginary input image of the sample with image processing software, wherein the real input image and the imaginary input image contain twin-image and/or interference-related artifacts. A trained deep neural network is provided that is executed by the image processing software using one or more processors and configured to receive the real input image and the imaginary input image of the sample and generate an output real image and an output imaginary image in which the twin-image and/or interference-related artifacts are substantially suppressed or eliminated. In some embodiments, the trained deep neural network simultaneously achieves phase-recovery and auto-focusing significantly extending the DOF of holographic image reconstruction.

公开(公告)号：US11262286B2

公开(公告)日：2022-03-01

申请号：US16858444

申请日：2020-04-24

Applicant: THE REGENTS OF THE UNIVERSITY OF CALIFORNIA

Inventor： Aydogan Ozcan ,  Yichen Wu

IPC: G01N15/02 ,  G03H1/22 ,  G03H1/04 ,  G06T7/00 ,  G06N3/04 ,  G06T7/62

Abstract: A label-free bio-aerosol sensing platform and method uses a field-portable and cost-effective device based on holographic microscopy and deep-learning, which screens bio-aerosols at a high throughput level. Two different deep neural networks are utilized to rapidly reconstruct the amplitude and phase images of the captured bio-aerosols, and to output particle information for each bio-aerosol that is imaged. This includes, a classification of the type or species of the particle, particle size, particle shape, particle thickness, or spatial feature(s) of the particle. The platform was validated using the label-free sensing of common bio-aerosol types, e.g., Bermuda grass pollen, oak tree pollen, ragweed pollen, Aspergillus spore, and Alternaria spore and achieved >94% classification accuracy. The label-free bio-aerosol platform, with its mobility and cost-effectiveness, will find several applications in indoor and outdoor air quality monitoring.