公开(公告)号：US11972618B2

公开(公告)日：2024-04-30

申请号：US17246409

申请日：2021-04-30

Applicant: Mashgin Inc.

Inventor： Abhinai Srivastava ,  Mukul Dhankhar

IPC: G06V20/64 ,  G06N3/04 ,  G06T7/00 ,  G06T7/38 ,  G06T7/557 ,  G06T7/593 ,  G06T7/62 ,  G06V10/145 ,  G06V10/764 ,  G06V10/80 ,  G06V10/82

CPC classification number: G06V20/64 ,  G06N3/04 ,  G06T7/38 ,  G06T7/557 ,  G06T7/593 ,  G06T7/62 ,  G06T7/97 ,  G06V10/145 ,  G06V10/764 ,  G06V10/809 ,  G06V10/82

Abstract: The method for item recognition can include: optionally calibrating a sampling system, determining visual data using the sampling system, determining a point cloud, determining region masks based on the point cloud, generating a surface reconstruction for each item, generating image segments for each item based on the surface reconstruction, and determining a class identifier for each item using the respective image segments.

公开(公告)号：US20240104946A1

公开(公告)日：2024-03-28

申请号：US18526629

申请日：2023-12-01

Applicant: Mashgin Inc.

Inventor： Abhinai Srivastava ,  Mukul Dhankhar

IPC: G06V20/64 ,  G01B11/245 ,  G06T7/11 ,  G06T7/174 ,  G06T7/194 ,  G06T17/00 ,  G06T17/10 ,  G06V20/20 ,  H04N23/60

CPC classification number: G06V20/653 ,  G01B11/245 ,  G06T7/11 ,  G06T7/174 ,  G06T7/194 ,  G06T17/00 ,  G06T17/10 ,  G06V20/20 ,  H04N23/60 ,  G06V10/245

Abstract: Methods, systems, and programs are presented for simultaneous recognition of objects within a detection space utilizing three-dimensional (3D) cameras configured for capturing 3D images of the detection space. One system includes the 3D cameras, calibrated based on a pattern in a surface of the detection space, a memory, and a processor. The processor combines data of the 3D images to obtain pixel data and removes, from the pixel data, background pixels of the detection space to obtain object pixel data associated with objects in the detection space. Further, the processor creates a geometric model of the object pixel data, the geometric model including surface information of the objects in the detection space, generates one or more cuts in the geometric model to separate objects and obtain respective object geometric models, and performs object recognition to identify each object in the detection space based on the respective object geometric models.

公开(公告)号：US11869256B2

公开(公告)日：2024-01-09

申请号：US17667279

申请日：2022-02-08

Applicant: Mashgin Inc.

Inventor： Abhinai Srivastava ,  Mukul Dhankhar

IPC: G06V20/64 ,  G06T7/194 ,  G06T7/11 ,  G06T7/174 ,  G06V20/20 ,  G01B11/245 ,  G06T17/00 ,  G06T17/10 ,  H04N23/60 ,  G06V10/24

CPC classification number: G06V20/653 ,  G01B11/245 ,  G06T7/11 ,  G06T7/174 ,  G06T7/194 ,  G06T17/00 ,  G06T17/10 ,  G06V20/20 ,  H04N23/60 ,  G06T2200/04 ,  G06T2200/08 ,  G06T2207/10024 ,  G06T2207/10028 ,  G06T2207/20221 ,  G06V10/245

Abstract: Methods, systems, and programs are presented for simultaneous recognition of objects within a detection space utilizing three-dimensional (3D) cameras configured for capturing 3D images of the detection space. One system includes the 3D cameras, calibrated based on a pattern in a surface of the detection space, a memory, and a processor. The processor combines data of the 3D images to obtain pixel data and removes, from the pixel data, background pixels of the detection space to obtain object pixel data associated with objects in the detection space. Further, the processor creates a geometric model of the object pixel data, the geometric model including surface information of the objects in the detection space, generates one or more cuts in the geometric model to separate objects and obtain respective object geometric models, and performs object recognition to identify each object in the detection space based on the respective object geometric models.

公开(公告)号：US20230112491A1

公开(公告)日：2023-04-13

申请号：US18079754

申请日：2022-12-12

Applicant: Mashgin Inc.

Inventor： Mukul Dhankhar

IPC: G06Q30/0601 ,  G01G19/40

Abstract: A system, method, and apparatus for automated object recognition and checkout at a retail kiosk is provided. The system includes a controller configured with a processor and a memory to control operations of the automated retail checkout system. The system further includes an imaging device in communication with the controller and configured to create multiple electronic images of an object, such as a product for purchase. The system also includes an object recognition device in communication with the controller and the imaging device. The processor may execute software to receive electronic images from the imaging device, extract at least one feature from the images, and recognize the object based on a predetermined model being applied to the extracted feature from the images. The system also includes a display device to display an indication of the recognized object from the object recognition device.

公开(公告)号：US20220165074A1

公开(公告)日：2022-05-26

申请号：US17667279

申请日：2022-02-08

Applicant: Mashgin Inc.

Inventor： Abhinai Srivastava ,  Mukul Dhankhar

IPC: G06V20/64 ,  G06T17/10 ,  G01B11/245 ,  G06T7/174 ,  G06T7/194 ,  G06T17/00 ,  H04N5/232 ,  G06T7/11 ,  G06V20/20

Abstract: Methods, systems, and programs are presented for simultaneous recognition of objects within a detection space utilizing three-dimensional (3D) cameras configured for capturing 3D images of the detection space. One system includes the 3D cameras, calibrated based on a pattern in a surface of the detection space, a memory, and a processor. The processor combines data of the 3D images to obtain pixel data and removes, from the pixel data, background pixels of the detection space to obtain object pixel data associated with objects in the detection space. Further, the processor creates a geometric model of the object pixel data, the geometric model including surface information of the objects in the detection space, generates one or more cuts in the geometric model to separate objects and obtain respective object geometric models, and performs object recognition to identify each object in the detection space based on the respective object geometric models.

公开(公告)号：US20210174431A1

公开(公告)日：2021-06-10

申请号：US17129296

申请日：2020-12-21

Applicant: Mashgin Inc.

Inventor： Mukul Dhankhar

IPC: G06Q30/06 ,  G01G19/40

Abstract: A system, method, and apparatus for automated object recognition and checkout at a retail kiosk is provided. The system includes a controller configured with a processor and a memory to control operations of the automated retail checkout system. The system further includes an imaging device in communication with the controller and configured to create multiple electronic images of an object, such as a product for purchase. The system also includes an object recognition device in communication with the controller and the imaging device. The processor may execute software to receive electronic images from the imaging device, extract at least one feature from the images, and recognize the object based on a predetermined model being applied to the extracted feature from the images. The system also includes a display device to display an indication of the recognized object from the object recognition device.

公开(公告)号：US20190236362A1

公开(公告)日：2019-08-01

申请号：US16180838

申请日：2018-11-05

Applicant: Mashgin Inc.

Inventor： Abhinai Srivastava ,  Mukul Dhankhar ,  Yong Li ,  Maxwell William Olson

IPC: G06K9/00 ,  G06Q20/20 ,  G06F15/18 ,  G06K9/78

Abstract: Methods, systems, and computer programs are presented for capturing color images of items for a machine-learning model. In one method, a request, for adding an item to be visually recognized during sales transactions, is detected at a checkout apparatus. Further, the method includes capturing and storing a color image, by each of one or more cameras of the checkout apparatus, of an examination space when the item is present. Further, the capturing and storing of color images of the item is repeated at different poses until at a predetermined number of color images of the item are captured. Further, the method includes generating, by a processor of the checkout apparatus, additional images of the item by modifying the captured color images. A machine-learning model for item recognition is built by training a machine-learning tool with the captured images and the additional images.

公开(公告)号：US20190065823A1

公开(公告)日：2019-02-28

申请号：US15685455

申请日：2017-08-24

Applicant: Mashgin Inc.

Inventor： Abhinai Srivastava ,  Mukul Dhankhar

IPC: G06K9/00 ,  G06T17/10

Abstract: Methods, systems, and programs are presented for simultaneous recognition of objects within a detection space utilizing three-dimensional (3D) cameras configured for capturing 3D images of the detection space. One system includes the 3D cameras, calibrated based on a pattern in a surface of the detection space, a memory, and a processor. The processor combines data of the 3D images to obtain pixel data and removes, from the pixel data, background pixels of the detection space to obtain object pixel data associated with objects in the detection space. Further, the processor creates a geometric model of the object pixel data, the geometric model including surface information of the objects in the detection space, generates one or more cuts in the geometric model to separate objects and obtain respective object geometric models, and performs object recognition to identify each object in the detection space based on the respective object geometric models.

公开(公告)号：US20190057438A1

公开(公告)日：2019-02-21

申请号：US16168066

申请日：2018-10-23

Applicant: Mashgin Inc.

Inventor： Mukul Dhankhar

IPC: G06Q30/06 ,  G01G19/40

Abstract: A system, method, and apparatus for automated object recognition at checkout is provided. One checkout system includes a base, a head portion, a support for the head portion above the base, an illumination device in the head portion, at least one imaging device in the head portion, a processor coupled to the at least one imaging device, and a display. An examination space is defined between the base and the head portion for accommodating food items. The illumination device illuminates the food items, and the at least one imaging device captures color images of the food items. The processor applies a machine-learning model for performing image recognition of the food items in the color images to identify each food item. The image recognition is based on features of the food items that include shape, size, and color. An identification of each of the food items is presented on the display.

公开(公告)号：US20190005343A1

公开(公告)日：2019-01-03

申请号：US16104087

申请日：2018-08-16

Applicant: Mashgin Inc.

Inventor： Abhinai Srivastava ,  Mukul Dhankhar

IPC: G06K9/00 ,  G06K9/66 ,  G06K9/34

Abstract: Methods, systems, and computer programs are presented for on-the-fly image recognition of an item in motion. One method includes an operation for periodically capturing images, by several cameras, of a recognition area. Further, the method includes detecting that the item is present in the recognition area and selecting a recognition window that defines a period of time for analysis. The recognition window defines recognition frames corresponding to the images captured within the recognition window. Each recognition frame is analyzed to determine if an identity of the item has been obtained for the recognition frame, the analysis being based on image recognition of the recognition frame to identify the item based on, at least, a shape of the item and coloring of the item. Further, the method includes operations for determining if the item has been identified based on the analysis for the recognition frames, and for displaying the item identification.