-
Patent Agency Ranking
公开(公告)号：US20210118123A1
公开(公告)日：2021-04-22
申请号：US17036475
申请日：2020-09-29
Applicant: TSINGHUA UNIVERSITY
Inventor： Lu Fang , Mengqi Ji , Shi Mao , Qionghai Dai
Abstract: The present disclosure provides a material identification method and a device based on laser speckle and modal fusion, an electronic device and a non-transitory computer readable storage medium. The method includes: performing data acquisition on an object by using a structured light camera to obtain a color modal image, a depth modal image and an infrared modal image; preprocessing the color modal image, the depth modal image and the infrared modal image; and inputting the color modal image, the depth modal image and the infrared modal image preprocessed into a preset depth neural network for training, to learn a material characteristic from a speckle structure and a coupling relation between color modal and depth modal, to generate a material classification model for classifying materials, and to generate a material prediction result in testing by the material classification model of the object.
-
2.发明授权公开(公告)号：US11954870B2
公开(公告)日：2024-04-09
申请号：US16975242
申请日：2019-04-23
Applicant: Tsinghua University
IPC: G06T7/593 , B64C39/02 , B64U101/30 , G06T7/292 , G06T17/00 , G06V10/80 , G06V20/13 , G06V20/17 , G06V20/64
CPC classification number: G06T7/292 , B64C39/024 , G06T7/593 , G06T17/00 , G06V10/803 , G06V20/13 , G06V20/17 , G06V20/653 , B64U2101/30 , G06T2207/10028 , G06T2207/20221
Abstract: Provided are a three-dimensional reconstruction method, apparatus and system of a dynamic scene, a server and a medium. The method includes: acquiring multiple continuous depth image sequences of the dynamic scene, where the multiple continuous depth image sequences are captured by an array of drones equipped with depth cameras; fusing the multiple continuous depth image sequences to establish a three-dimensional reconstruction model of the dynamic scene; obtaining target observation points of the array of drones through calculation according to the three-dimensional reconstruction model and current poses of the array of drones; and instructing the array of drones to move to the target observation points to capture, and updating the three-dimensional reconstruction model according to multiple continuous depth image sequences captured by the array of drones at the target observation points.
-
3.发明申请公开(公告)号：US20210110599A1
公开(公告)日：2021-04-15
申请号：US16977899
申请日：2019-04-28
Applicant: Tsinghua University
Inventor： Lu Fang , Mengqi Ji , Lei Han , Zhuo Su , Qionghai Dai
Abstract: Provided are a depth camera based three-dimensional reconstruction method and apparatus, a device and a storage medium. The method includes: acquiring at least two frames of images obtained by capturing a target scenario by a depth camera; determining, according to the at least two frames of images, relative camera poses in response to capturing the target scenario by the depth camera; by adopting a manner of at least two levels of nested screening, determining at least one feature voxel from each frame of image, where each level of screening adopts a respective voxel partitioning rule; fusing and calculating the at least one feature voxel of each frame of image according to a respective relative camera pose of each frame of image to obtain a grid voxel model of the target scenario; and generating an isosurface of the grid voxel model to obtain a three-dimensional reconstruction model of the target scenario.
-
公开(公告)号：US11782285B2
公开(公告)日：2023-10-10
申请号：US17036475
申请日：2020-09-29
Applicant: TSINGHUA UNIVERSITY
Inventor： Lu Fang , Mengqi Ji , Shi Mao , Qionghai Dai
IPC: G06T7/00 , G02B27/48 , G01N21/39 , G06T5/00 , G06F18/214 , G06F18/25 , G06V10/56 , G06V10/764 , G06V10/774 , G06V10/80 , G06V10/82 , G06V10/60 , G06V10/143
CPC classification number: G02B27/48 , G01N21/39 , G06F18/214 , G06F18/251 , G06T5/009 , G06T7/0004 , G06V10/143 , G06V10/56 , G06V10/60 , G06V10/764 , G06V10/774 , G06V10/803 , G06V10/82 , G06T2207/10024 , G06T2207/10028 , G06T2207/10048 , G06T2207/20081 , G06T2207/20084
Abstract: The present disclosure provides a material identification method and a device based on laser speckle and modal fusion, an electronic device and a non-transitory computer readable storage medium. The method includes: performing data acquisition on an object by using a structured light camera to obtain a color modal image, a depth modal image and an infrared modal image; preprocessing the color modal image, the depth modal image and the infrared modal image; and inputting the color modal image, the depth modal image and the infrared modal image preprocessed into a preset depth neural network for training, to learn a material characteristic from a speckle structure and a coupling relation between color modal and depth modal, to generate a material classification model for classifying materials, and to generate a material prediction result in testing by the material classification model of the object.
-
5.发明申请公开(公告)号：US20210074012A1
公开(公告)日：2021-03-11
申请号：US16975242
申请日：2019-04-23
Applicant: Tsinghua University
Abstract: Provided are a three-dimensional reconstruction method, apparatus and system of a dynamic scene, a server and a medium. The method includes: acquiring multiple continuous depth image sequences of the dynamic scene, where the multiple continuous depth image sequences are captured by an array of drones equipped with depth cameras; fusing the multiple continuous depth image sequences to establish a three-dimensional reconstruction model of the dynamic scene; obtaining target observation points of the array of drones through calculation according to the three-dimensional reconstruction model and current poses of the array of drones; and instructing the array of drones to move to the target observation points to capture, and updating the three-dimensional reconstruction model according to multiple continuous depth image sequences captured by the array of drones at the target observation points.
-
-
-
-
Search Results
5
records
(took 0.01 seconds)
