公开(公告)号：US10346997B2

公开(公告)日：2019-07-09

申请号：US15809769

申请日：2017-11-10

Applicant: Graduate School at Shenzhen, Tsinghua University

Inventor： Xin Jin ,  Yatong Xu ,  Qionghai Dai

IPC: G06T7/557 ,  G06T7/571 ,  H04N5/225 ,  G06T1/00 ,  H04N5/222

Abstract: A depth estimation method based on light-field data distribution includes the following steps: S1. adjusting pixel distribution of input light-field images to generate a series of refocused light-field images having different focal lengths; S2. for a spatial point, corresponding to a macro-pixel, extracting intensity ranges for the macro-pixel from the refocused light-field images, and then selecting one refocused light-field image corresponding to a minimum intensity range, the focal length of the selected refocused light-field image being taken as a scene depth of the macro-pixel; the macro-pixel corresponding to one point in an actual scene, the intensity range of the macro-pixel being a variation range of intensity values of all points within the macro-pixel; and repeating the step S2 to obtain scene depths of all macro-pixels.

公开(公告)号：US10254529B2

公开(公告)日：2019-04-09

申请号：US15862106

申请日：2018-01-04

Applicant: Tsinghua University

Inventor： Qionghai Dai ,  Jingtao Fan

IPC: G02B21/36 ,  G02B21/00 ,  G02F1/133

Abstract: A method and an apparatus for calibrating an image sensor array in a microscopic imaging system are provided. The method includes: performing a vignetting effect calibration and correction on the image sensor array, such that pixels acquired by all sub-field-of-view image sensors for capturing a scene with a same radiant exitance have a same gray level; performing a light encoding on a temporal-spatial union structure using a spatial light modulator, to establish correspondences of a plurality of feature points between an image space and a physical space; performing a light decoding on the temporal-spatial union structure, to acquire pixel coordinates of the plurality of feature points in an image plane and physical coordinates of the plurality of feature points in a plane of the spatial light modulator; acquiring a homography relationship according to the pixel coordinates and the physical coordinates, acquiring a global coordinate mapping according to the homography relationship.

公开(公告)号：US20180340821A1

公开(公告)日：2018-11-29

申请号：US15819570

申请日：2017-11-21

Applicant: TSINGHUA UNIVERSITY

Inventor： Qionghai Dai ,  Liheng Bian ,  Feng Chen ,  Jinli Suo

IPC: G01J1/44 ,  G01J1/08 ,  G02B21/26 ,  G02B21/06 ,  G02B21/36

Abstract: A microscopic tomography device based on light-sheet and single-pixel imaging is provided. The device includes: a light source; a pattern modulator, configured to modulate light from the light source into different illumination patterns; a light modulator, configured to modulate the illumination patterns as patterned light sheets; a detector, configured to detect the light passing through the sample after the sample is illuminated by the patterned light sheets; a focusing lens, configured to focus the light passing through the sample onto the detector; and a reconstruction component, configured to reconstruct an image of the sample at the illuminated depth using the illumination patterns, corresponding measurements and a single-pixel imaging algorithm.

公开(公告)号：US20180330057A1

公开(公告)日：2018-11-15

申请号：US15830165

申请日：2017-12-04

Applicant: Tsinghua University

Inventor： Qionghai Dai ,  Feng Bao ,  Jinli Suo

IPC: G06F19/24 ,  G06F19/12

CPC classification number: G06F19/24 ,  G06F19/12

Abstract: The present disclosure provides a genome-wide association study method for imbalanced samples, including: randomly selecting L subsets from the healthy samples; pairing each of the L subsets with the diseased samples to obtain L sample combinations, and determining key genetic loci corresponding to each sample combination; evaluating a score of an importance degree of each sample combination according to times that each key genetic locus is determined in the L sample combinations; for each healthy sample, determining a mean value of scores of an importance degree of sample combinations that the healthy sample is assigned to, and determining the mean value as a confidence score of the healthy sample; and normalizing the confidence score of each healthy sample to obtain a weight of each healthy sample, and performing weighted logistic regression according to the weight of each healthy sample.

公开(公告)号：US20180114328A1

公开(公告)日：2018-04-26

申请号：US15809769

申请日：2017-11-10

Applicant: Graduate School at Shenzhen, Tsinghua University

Inventor： Xin JIN ,  Yatong Xu ,  Qionghai Dai

IPC: G06T7/557 ,  G06T7/571 ,  H04N5/225 ,  G06T1/00

CPC classification number: G06T7/557 ,  G06T1/0007 ,  G06T7/571 ,  G06T2207/10028 ,  G06T2207/10052 ,  H04N5/2226 ,  H04N5/225 ,  H04N5/2254

Abstract: A depth estimation method based on light-field data distribution includes the following steps: S1. adjusting pixel distribution of input light-field images to generate a series of refocused light-field images having different focal lengths; S2. for a spatial point, corresponding to a macro-pixel, extracting intensity ranges for the macro-pixel from the refocused light-field images, and then selecting one refocused light-field image corresponding to a minimum intensity range, the focal length of the selected refocused light-field image being taken as a scene depth of the macro-pixel; the macro-pixel corresponding to one point in an actual scene, the intensity range of the macro-pixel being a variation range of intensity values of all points within the macro-pixel; and repeating the step S2 to obtain scene depths of all macro-pixels.

公开(公告)号：US09386296B2

公开(公告)日：2016-07-05

申请号：US14194931

申请日：2014-03-03

Applicant: Tsinghua University

Inventor： Qionghai Dai ,  Xing Lin ,  Jinli Suo

IPC: H04N13/00 ,  H04N13/02 ,  H04N5/335

CPC classification number: H04N13/207 ,  H04N5/335 ,  H04N13/271

Abstract: A method and an apparatus for coded focal stack photographing are provided. The method includes: changing a focal surface within a single exposure time and per-pixel coding a sensor readout for each focal surface to obtain a modulation function M(y,z), where y⊂{y1,y2} is a two-dimensional spatial coordinate and z is a depth coordinate of a latent three-dimensional focal stack F(y,z); coding the latent three-dimensional focal stack F(y,z) into a two-dimensional sensor image I(y) by using the modulation function M(y,z); and achieving one or more of a programmable non-planar focal surface imaging, an interleaved focal stack imaging, and a compressive focal stack imaging, based on the modulation functions M(y,z) and the two-dimensional sensor image I(y).

Abstract translation: 提供了一种用于编码焦点堆叠拍摄的方法和装置。 该方法包括：在单个曝光时间内改变焦点表面，并对每个焦面进行每像素编码传感器读数，以获得调制函数M（y，z），其中y⊂{y1，y2}是二维 空间坐标，z是潜在三维焦点堆栈F（y，z）的深度坐标; 通过使用调制函数M（y，z）将潜在三维焦点堆栈F（y，z）编码成二维传感器图像I（y）; 并且基于调制函数M（y，z）和二维传感器图像I（y）实现可编程非平面焦平面成像，交错焦点堆叠成像和压缩焦点堆叠成像中的一个或多个， 。

公开(公告)号：US11954870B2

公开(公告)日：2024-04-09

申请号：US16975242

申请日：2019-04-23

Applicant: Tsinghua University

Inventor： Lu Fang ,  Mengqi Ji ,  Yebin Liu ,  Lan Xu ,  Wei Cheng ,  Qionghai Dai

IPC: G06T7/593 ,  B64C39/02 ,  B64U101/30 ,  G06T7/292 ,  G06T17/00 ,  G06V10/80 ,  G06V20/13 ,  G06V20/17 ,  G06V20/64

CPC classification number: G06T7/292 ,  B64C39/024 ,  G06T7/593 ,  G06T17/00 ,  G06V10/803 ,  G06V20/13 ,  G06V20/17 ,  G06V20/653 ,  B64U2101/30 ,  G06T2207/10028 ,  G06T2207/20221

Abstract: Provided are a three-dimensional reconstruction method, apparatus and system of a dynamic scene, a server and a medium. The method includes: acquiring multiple continuous depth image sequences of the dynamic scene, where the multiple continuous depth image sequences are captured by an array of drones equipped with depth cameras; fusing the multiple continuous depth image sequences to establish a three-dimensional reconstruction model of the dynamic scene; obtaining target observation points of the array of drones through calculation according to the three-dimensional reconstruction model and current poses of the array of drones; and instructing the array of drones to move to the target observation points to capture, and updating the three-dimensional reconstruction model according to multiple continuous depth image sequences captured by the array of drones at the target observation points.

公开(公告)号：US11514667B1

公开(公告)日：2022-11-29

申请号：US17704202

申请日：2022-03-25

Applicant: Tsinghua University

Inventor： Lu Fang ,  Tiankuang Zhou ,  Siyuan Gu ,  Xiaoyun Yuan ,  Qionghai Dai

IPC: G06V10/82 ,  G06V10/774 ,  G06V10/145 ,  G06N3/067

Abstract: A method and an apparatus for camera-free light field video processing with all-optical neural network are disclosed. The method includes: mapping the light field video by a digital micro-mirror device (DMD) and an optical fiber coupler, a two-dimensional 2D spatial optical signal into a one-dimensional 1D input optical signal; realizing a multiply-accumulate computing model in a structure of all-optical recurrent neural network structure, and processing the 1D input signal to obtain the processed signal; and receiving the processed signal and outputting an electronic signal by a photodetector, or receiving the processed signal by a relay optical fiber for relay transmission of the processed signal. The method and system here realize light field video processing without the use of a camera and the whole system is all-optical, thus possessing the advantage in computing speed and energy-efficiency.

公开(公告)号：US11169367B2

公开(公告)日：2021-11-09

申请号：US16357811

申请日：2019-03-19

Applicant: TSINGHUA UNIVERSITY

Inventor： Qionghai Dai ,  Zhi Lu ,  Jiamin Wu

IPC: H04N13/204 ,  G02B21/36 ,  G02B21/22

Abstract: Provided are a 3D microscopic imaging method and a 3D microscopic imaging system. The method includes: acquiring a first PSF of a 3D sample from an object plane to a plane of a main camera sensor and a second PSF of the 3D sample from the object plane to a plane of a secondary camera sensor, and generating a first forward projection matrix corresponding to the first PSF and a second forward projection matrix corresponding to the second PSF; acquiring a light field image captured by the main camera sensor and a high resolution image captured by the secondary camera sensor; generating a reconstruction result of the 3D sample by reconstructing the light field image, the first forward projection matrix, the high resolution image and the second forward projection matrix according to a preset algorithm.

公开(公告)号：US20210118162A1

公开(公告)日：2021-04-22

申请号：US17034563

申请日：2020-09-28

Applicant: Tsinghua University

Inventor： Lu FANG ,  Dingjian Jin ,  Anke Zhang ,  Qionghai Dai

IPC: G06T7/557 ,  G06T7/80 ,  H04N13/128 ,  H04N13/246

Abstract: A depth information calculation method and device based on a light-field-binocular system. The method includes obtaining a far-distance disparity map based on binocular information of calibrated input images, setting respective first confidences pixels in the disparity map, and obtaining a first target confidence; detecting the first confidence of a pixel being smaller than a preset value and responsively determining a new disparity value based on light field information of the input images, determining an update depth value based on the new disparity value, and obtaining a second target confidence of the pixel; and combining the far-distance disparity map and a disparity map formed by the new disparity value on a same unit into an index map, combining the first confidence and the first target confidence into a confidence map, optimizing the index and confidence maps to obtain a final disparity map, which is converted to a final depth map.