公开(公告)号：US10572072B2

公开(公告)日：2020-02-25

申请号：US15721207

申请日：2017-09-29

Applicant: Apple Inc.

Inventor： Lejing Wang ,  Daniel Kurz

IPC: G06F3/042 ,  G06K9/00 ,  H04N13/271

Abstract: Systems, methods, and computer readable media to improve the operation of detecting contact between a finger or other object and a surface are described. In general, techniques disclosed herein utilize a depth map to identify an object and a surface, and a classifier to determine when the object is touching the surface. Unlike the prior art, a measure of the object's “distance” is made relative to the surface and not the camera(s) thereby providing some measure of invariance with respect to camera pose. The object-surface distance measure can be used to construct an identifier or “feature vector” that, when applied to a classifier, generates an output indicative of whether the object is touching the surface. The classifier may be based on machine learning and can be trained off-line before run-time operations are commenced. In some embodiments, temporal filtering may be used to improve surface detection operations.

公开(公告)号：US20190102044A1

公开(公告)日：2019-04-04

申请号：US15721207

申请日：2017-09-29

Applicant: Apple Inc.

Inventor： Lejing Wang ,  Daniel Kurz

IPC: G06F3/042 ,  G06K9/00 ,  H04N13/02

Abstract: Systems, methods, and computer readable media to improve the operation of detecting contact between a finger or other object and a surface are described. In general, techniques disclosed herein utilize a depth map to identify an object and a surface, and a classifier to determine when the object is touching the surface. Unlike the prior art, a measure of the object's “distance” is made relative to the surface and not the camera(s) thereby providing some measure of invariance with respect to camera pose. The object-surface distance measure can be used to construct an identifier or “feature vector” that, when applied to a classifier, generates an output indicative of whether the object is touching the surface. The classifier may be based on machine learning and can be trained off-line before run-time operations are commenced. In some embodiments, temporal filtering may be used to improve surface detection operations.

公开(公告)号：US10192145B2

公开(公告)日：2019-01-29

申请号：US15444404

申请日：2017-02-28

Applicant: Apple Inc.

Inventor： Mohamed Selim Ben Himane ,  Daniel Kurz ,  Thomas Olszamowski

IPC: G06K9/62 ,  G06K9/46

Abstract: A method of providing a set of feature descriptors configured to be used in matching an object in an image of a camera is provided. The method includes: a) providing at least two images of a first object; b) extracting in at least two of the images at least one feature from the respective image, c) providing at least one descriptor for an extracted feature, and storing the descriptors; d) matching descriptors in the first set of descriptors; e) computing a score parameter based on the result of the matching process; f) selecting at least one descriptor based on its score parameter; g) adding the selected descriptor(s) to a second set of descriptors; and h) updating the score parameter of descriptors in the first set based on a selection process and to the result of the matching process.