公开(公告)号：US20200242735A1

公开(公告)日：2020-07-30

申请号：US16357850

申请日：2019-03-19

Applicant: TSINGHUA UNIVERSITY

Inventor： Qionghai Dai ,  Zhi Lu ,  Jiamin Wu

IPC: G06T3/40 ,  G02B21/00 ,  H01L27/146 ,  G02B26/10 ,  G02B26/12

Abstract: A super-resolution lattice light field microscopic imaging system includes: a microscope configured to magnify a sample and image the sample onto a first image plane of the microscope; a first relay lens configured to match a numerical aperture of an objective with that of a microlens array; a 2D scanning galvo configured to rotate an angle of a light path in the frequency domain plane; an illuminating system configured to provide uniform illumination on the microlens array to generate SIM pattern illumination; the microlens array, configured to modulate a light beam with a preset angle to a target spatial position at a back focal plane of the microlens array to obtain a modulated image; an image sensor configured to record the modulated image; and a reconstruction module configured to reconstruct a 3D structure of the sample based on the modulated image.

公开(公告)号：US10349058B2

公开(公告)日：2019-07-09

申请号：US15660476

申请日：2017-07-26

Applicant: Graduate School at Shenzhen, Tsinghua University

Inventor： Xin Jin ,  Chenyang Li ,  Qionghai Dai

IPC: H04N13/194 ,  H04N13/271 ,  H04N19/105 ,  H04N19/147 ,  H04N19/176 ,  H04N19/597

Abstract: Disclosed is a method for predicting depth map coding distortion of a two-dimensional free viewpoint video, including: inputting sequences of texture maps and depth maps of two or more viewpoint stereoscopic videos; synthesizing a texture map of a first intermediate viewpoint of a current to-be-coded viewpoint and a first adjacent viewpoint, and synthesizing a texture map of a second intermediate viewpoint of the current to-be-coded viewpoint and a second adjacent viewpoint by using a view synthesis algorithm; recording a synthetic characteristic of each pixel according to the texture map and generating a distortion prediction weight; and calculating to obtain total distortion according to the synthetic characteristic and the distortion prediction weight.

公开(公告)号：US20190005701A1

公开(公告)日：2019-01-03

申请号：US15944403

申请日：2018-04-03

Applicant: TSINGHUA UNIVERSITY

Inventor： Qionghai Dai ,  Mingjie Zhang ,  Jiamin Wu

IPC: G06T15/00 ,  G02B21/06 ,  G02B21/36

Abstract: Microscopic imaging system and method with three-dimensional refractive index tomography are provided. The microscopic imaging system includes: an illumination providing module, configured to provide a beam of parallel lights with a modulated intensity; a microscopic sample, arranged at downstream of the illumination providing module, and configured to modulate a phase of the beam of parallel lights, such that emergent lights passing through the microscopic sample carry information of a three-dimensional refractive index field of the microscopic sample; a microscopic imaging module, arranged at downstream of the microscopic sample, and configured to form an image by using the emergent lights; and a controlling module, configured to process the image to reconstruct three-dimensional refractive index information of the microscopic sample.

公开(公告)号：US08866972B1

公开(公告)日：2014-10-21

申请号：US14279848

申请日：2014-05-16

Applicant: Tsinghua University

Inventor： Qionghai Dai ,  Chenguang Ma ,  Jinli Suo

IPC: H04N5/91 ,  H04N17/02

CPC classification number: G01J3/28 ,  G01J2003/2826

Abstract: A method for transmitting spectrum information is provided. The method includes: sampling a first video of a scene by a first sampling device and sampling a spectrum video of a sampling point in the scene by a second sampling device, and processing the spectrum video to obtain a spectrum information of the sampling point; calculating estimated transmission ratio coefficients of the spectrum video according to color integral curves of the first sampling device; estimating a location of the sampling point in each frame of the first video; and transmitting the spectrum information of the sampling point to a plurality of scene points in the first video according to the estimated transmission ratio coefficients and the location of the sampling point in each frame of the spectrum video through a trilateral filtering algorithm.

Abstract translation: 提供了一种用于发送频谱信息的方法。 该方法包括：通过第一采样装置对场景的第一视频进行采样，并通过第二采样装置对场景中的采样点的频谱视频进行采样，并处理频谱以获得采样点的频谱信息; 根据第一采样装置的色彩积分曲线计算频谱视频的估计传输比系数; 估计第一视频的每个帧中的采样点的位置; 并且通过三边滤波算法，根据估计的传输比系数和频谱视频的每个帧中的采样点的位置，将采样点的频谱信息发送到第一视频中的多个场景点。

公开(公告)号：US11782285B2

公开(公告)日：2023-10-10

申请号：US17036475

申请日：2020-09-29

Applicant: TSINGHUA UNIVERSITY

Inventor： Lu Fang ,  Mengqi Ji ,  Shi Mao ,  Qionghai Dai

IPC: G06T7/00 ,  G02B27/48 ,  G01N21/39 ,  G06T5/00 ,  G06F18/214 ,  G06F18/25 ,  G06V10/56 ,  G06V10/764 ,  G06V10/774 ,  G06V10/80 ,  G06V10/82 ,  G06V10/60 ,  G06V10/143

CPC classification number: G02B27/48 ,  G01N21/39 ,  G06F18/214 ,  G06F18/251 ,  G06T5/009 ,  G06T7/0004 ,  G06V10/143 ,  G06V10/56 ,  G06V10/60 ,  G06V10/764 ,  G06V10/774 ,  G06V10/803 ,  G06V10/82 ,  G06T2207/10024 ,  G06T2207/10028 ,  G06T2207/10048 ,  G06T2207/20081 ,  G06T2207/20084

Abstract: The present disclosure provides a material identification method and a device based on laser speckle and modal fusion, an electronic device and a non-transitory computer readable storage medium. The method includes: performing data acquisition on an object by using a structured light camera to obtain a color modal image, a depth modal image and an infrared modal image; preprocessing the color modal image, the depth modal image and the infrared modal image; and inputting the color modal image, the depth modal image and the infrared modal image preprocessed into a preset depth neural network for training, to learn a material characteristic from a speckle structure and a coupling relation between color modal and depth modal, to generate a material classification model for classifying materials, and to generate a material prediction result in testing by the material classification model of the object.

公开(公告)号：US11715186B2

公开(公告)日：2023-08-01

申请号：US17036493

申请日：2020-09-29

Applicant: TSINGHUA UNIVERSITY

Inventor： Lu Fang ,  Yinheng Zhu ,  Qionghai Dai

IPC: G06K9/36 ,  G06T5/50 ,  G06N3/08 ,  G06T3/40 ,  G06T9/00 ,  G06F18/25 ,  G06V10/764 ,  G06V10/80 ,  G06V10/82 ,  G06V10/44

CPC classification number: G06T5/50 ,  G06F18/253 ,  G06N3/08 ,  G06T3/4053 ,  G06T9/00 ,  G06V10/454 ,  G06V10/764 ,  G06V10/806 ,  G06V10/82 ,  G06T2207/20084 ,  G06T2207/20221

Abstract: The present disclosure provides a multi-image-based image enhancement method and device, an electronic device and a non-transitory computer readable storage medium. The method includes: aligning a low-resolution target image and a reference image in an image domain; performing, an alignment in a feature domain; and synthesizing features corresponding to the low-resolution target image and features corresponding to the reference image to generate a final output.

公开(公告)号：US11131841B2

公开(公告)日：2021-09-28

申请号：US16357870

申请日：2019-03-19

Applicant: TSINGHUA UNIVERSITY

Inventor： Qionghai Dai ,  Zhi Lu ,  Jiamin Wu

IPC: G02B21/22 ,  G02B21/36 ,  H04N13/106 ,  H04N13/207

Abstract: A scanning light field microscopic imaging system includes: a microscope configured to magnify a sample and image the sample onto a first image plane of the microscope; a relay lens configured to magnify or minify the first image plane; a 2D scanning galvo configured to rotate an angle of a light path in the frequency domain plane; the microlens array configured to modulate a beam with a preset angle to a target spatial position at a back focal plane of the microlens array and modulate the first image plane to obtain a modulated image; an image sensor configured to record the modulated image; and a reconstruction module configured to reconstruct a 3D structure of the sample based on the modulated image acquired from the image sensor.

公开(公告)号：US20200241276A1

公开(公告)日：2020-07-30

申请号：US16357811

申请日：2019-03-19

Applicant: TSINGHUA UNIVERSITY

Inventor： Qionghai Dai ,  Zhi Lu ,  Jiamin WU

IPC: G02B21/36 ,  G02B21/22 ,  H04N13/204

Abstract: Provided are a 3D microscopic imaging method and a 3D microscopic imaging system. The method includes: acquiring a first PSF of a 3D sample from an object plane to a plane of a main camera sensor and a second PSF of the 3D sample from the object plane to a plane of a secondary camera sensor, and generating a first forward projection matrix corresponding to the first PSF and a second forward projection matrix corresponding to the second PSF; acquiring a light field image captured by the main camera sensor and a high resolution image captured by the secondary camera sensor; generating a reconstruction result of the 3D sample by reconstructing the light field image, the first forward projection matrix, the high resolution image and the second forward projection matrix according to a preset algorithm.

公开(公告)号：US20200241274A1

公开(公告)日：2020-07-30

申请号：US16357870

申请日：2019-03-19

Applicant: TSINGHUA UNIVERSITY

Inventor： Qionghai Dai ,  Zhi Lu ,  Jiamin Wu

IPC: G02B21/36 ,  H04N13/106 ,  H04N13/207

Abstract: A scanning light field microscopic imaging system includes: a microscope configured to magnify a sample and image the sample onto a first image plane of the microscope; a relay lens configured to magnify or minify the first image plane; a 2D scanning galvo configured to rotate an angle of a light path in the frequency domain plane; the microlens array configured to modulate a beam with a preset angle to a target spatial position at a back focal plane of the microlens array and modulate the first image plane to obtain a modulated image; an image sensor configured to record the modulated image; and a reconstruction module configured to reconstruct a 3D structure of the sample based on the modulated image acquired from the image sensor.

公开(公告)号：US10539506B2

公开(公告)日：2020-01-21

申请号：US15790714

申请日：2017-10-23

Applicant: Tsinghua University

Inventor： Qionghai Dai ,  Ziwei Li

IPC: G01N21/64 ,  G02B21/06 ,  G02B27/00 ,  G02B21/36 ,  G02B21/24

Abstract: A microscopy imaging system is disclosed. The system includes: a femtosecond laser; an acousto-optic modulator, configured to periodically modulate an intensity of a laser light; a line-scanning component, configured to focus the laser light to form a line-shaped beam and to scan in a direction perpendicular to the line-shaped beam; a chromatic dispersion component, configured to generate spatial chirped laser pulses; a collimating lens, configured to converge components with different wavelengths dispersed by the chromatic dispersion component to propagate in parallel; a microscope component, configured to guide light passing through the collimating lens to illuminate the sample and capture a fluorescence image at a focal plane; and a synchronous control component, configured to synchronously control the acousto-optic modulator to modulate the intensity of the laser light, the line-scanning component to scan and the microscope component to capture fluorescence images, such that a reconstructed image is obtained according to the images.