-
公开(公告)号:US20200342208A1
公开(公告)日:2020-10-29
申请号:US16923674
申请日:2020-07-08
Applicant: Mashgin Inc.
Inventor: Abhinai Srivastava , Mukul Dhankhar
Abstract: Methods, systems, and programs are presented for simultaneous recognition of objects within a detection space utilizing three-dimensional (3D) cameras configured for capturing 3D images of the detection space. One system includes the 3D cameras, calibrated based on a pattern in a surface of the detection space, a memory, and a processor. The processor combines data of the 3D images to obtain pixel data and removes, from the pixel data, background pixels of the detection space to obtain object pixel data associated with objects in the detection space. Further, the processor creates a geometric model of the object pixel data, the geometric model including surface information of the objects in the detection space, generates one or more cuts in the geometric model to separate objects and obtain respective object geometric models, and performs object recognition to identify each object in the detection space based on the respective object geometric models.
-
12.
公开(公告)号:US10467454B2
公开(公告)日:2019-11-05
申请号:US15497730
申请日:2017-04-26
Applicant: Mashgin Inc.
Inventor: Abhinai Srivastava , Mukul Dhankhar
IPC: G06K9/00 , G06K9/32 , H04N13/243 , H04N13/25 , H04N13/296 , G01B11/245 , G07G1/00 , G06Q20/20 , H04N13/254 , G06T7/55 , G03B37/04
Abstract: Methods, systems, and computer programs are presented for object recognition performed by electronic devices. One method includes an operation for capturing three-dimensional (3D) images of a region over a surface using 3D cameras, the surface having a pattern and each 3D camera defining a respective camera coordinate system. For each camera, the 3D image is analyzed to identify a location of the pattern indicating an origin of a common coordinate system, and a coordinate transformation function is defined to convert data to the common coordinate system. Each 3D camera captures a 3D object image of an object on the surface that includes 3D object data. The 3D object data is transformed to the common coordinate system to obtain transformed 3D object data. The 3D object data is combined to obtain a composite 3D object data, and object recognition of the object is performed based on the composite 3D object data.
-
公开(公告)号:US12002245B2
公开(公告)日:2024-06-04
申请号:US17323943
申请日:2021-05-18
Applicant: Mashgin Inc.
Inventor: Abhinai Srivastava , Mukul Dhankhar
IPC: G06K9/00 , G06F16/51 , G06F18/214 , G06F18/22 , G06F18/24 , G06N20/00 , G06Q20/20 , G06T9/00 , G06V10/764 , G06V10/80 , G06V10/82 , G06V20/10 , G06N3/04
CPC classification number: G06T9/002 , G06F16/51 , G06F18/214 , G06F18/22 , G06F18/24 , G06N20/00 , G06Q20/201 , G06Q20/202 , G06Q20/203 , G06V10/764 , G06V10/806 , G06V10/82 , G06V20/10 , G06N3/04
Abstract: The method for item identification preferably includes determining visual information for an item; calculating a first encoding using the visual information; calculating a second encoding using the first encoding; determining an item identifier for the item using the second encoding; optionally presenting information associated with the item to a user; and optionally registering a new item.
-
公开(公告)号:US11551287B2
公开(公告)日:2023-01-10
申请号:US17129296
申请日:2020-12-21
Applicant: Mashgin Inc.
Inventor: Mukul Dhankhar
Abstract: A system, method, and apparatus for automated object recognition and checkout at a retail kiosk is provided. The system includes a controller configured with a processor and a memory to control operations of the automated retail checkout system. The system further includes an imaging device in communication with the controller and configured to create multiple electronic images of an object, such as a product for purchase. The system also includes an object recognition device in communication with the controller and the imaging device. The processor may execute software to receive electronic images from the imaging device, extract at least one feature from the images, and recognize the object based on a predetermined model being applied to the extracted feature from the images. The system also includes a display device to display an indication of the recognized object from the object recognition device.
-
公开(公告)号:US20210272088A1
公开(公告)日:2021-09-02
申请号:US17323943
申请日:2021-05-18
Applicant: Mashgin Inc.
Inventor: Abhinai Srivastava , Mukul Dhankhar
Abstract: The method for item identification preferably includes determining visual information for an item; calculating a first encoding using the visual information; calculating a second encoding using the first encoding; determining an item identifier for the item using the second encoding; optionally presenting information associated with the item to a user; and optionally registering a new item.
-
公开(公告)号:US20210256724A1
公开(公告)日:2021-08-19
申请号:US17246409
申请日:2021-04-30
Applicant: Mashgin Inc.
Inventor: Abhinai Srivastava , Mukul Dhankhar
Abstract: The method for item recognition can include: optionally calibrating a sampling system, determining visual data using the sampling system, determining a point cloud, determining region masks based on the point cloud, generating a surface reconstruction for each item, generating image segments for each item based on the surface reconstruction, and determining a class identifier for each item using the respective image segments.
-
公开(公告)号:US20210124906A1
公开(公告)日:2021-04-29
申请号:US17079056
申请日:2020-10-23
Applicant: Mashgin Inc.
Inventor: Abhinai Srivastava , Mukul Dhankhar
Abstract: The method for item identification preferably includes determining visual information for an item; calculating a first encoding using the visual information; calculating a second encoding using the first encoding; determining an item identifier for the item using the second encoding; optionally presenting information associated with the item to a user; and optionally registering a new item.
-
公开(公告)号:US10540551B2
公开(公告)日:2020-01-21
申请号:US16180838
申请日:2018-11-05
Applicant: Mashgin Inc.
Inventor: Abhinai Srivastava , Mukul Dhankhar , Yong Li , Maxwell William Olson
Abstract: Methods, systems, and computer programs are presented for capturing color images of items for a machine-learning model. In one method, a request, for adding an item to be visually recognized during sales transactions, is detected at a checkout apparatus. Further, the method includes capturing and storing a color image, by each of one or more cameras of the checkout apparatus, of an examination space when the item is present. Further, the capturing and storing of color images of the item is repeated at different poses until at a predetermined number of color images of the item are captured. Further, the method includes generating, by a processor of the checkout apparatus, additional images of the item by modifying the captured color images. A machine-learning model for item recognition is built by training a machine-learning tool with the captured images and the additional images.
-
公开(公告)号:US20190236360A1
公开(公告)日:2019-08-01
申请号:US15883355
申请日:2018-01-30
Applicant: Mashgin Inc.
Inventor: Abhinai Srivastava , Mukul Dhankhar , Yong Li , Maxwell William Olson
CPC classification number: G06K9/00671 , G06K9/00201 , G06K9/6272 , G06K9/6289 , G06K9/78 , G06K2209/17 , G06N20/00 , G06Q20/201 , G06Q20/208
Abstract: Methods, systems, and computer programs are presented for providing a feedback loop to improve object image-based recognition based on transaction data. In one method, instructions are received defining items to be visually recognized by a terminal. For each item, a check is made to determine if item image information is in a global database or if it is a new item. The global database includes item images captured during transactions performed at several terminals. For each item in the global database, item image information is downloaded from the global database. For new items, terminal cameras capture pose images for several poses of the new items, each camera taking an image for each pose. A machine-learning program is trained with the downloaded image information and the pose images, where the machine-learning program performs image-based recognition of the items that are presented at the terminal, based on images captured by the cameras.
-
公开(公告)号:US10366445B2
公开(公告)日:2019-07-30
申请号:US14517634
申请日:2014-10-17
Applicant: MASHGIN INC.
Inventor: Mukul Dhankhar
Abstract: A system, method, and apparatus for automated object recognition and checkout at a retail kiosk is provided. The system includes a controller configured with a processor and a memory to control operations of the automated retail checkout system. The system further includes an imaging device in communication with the controller and configured to create multiple electronic images of an object, such as a product for purchase. The system also includes an object recognition device in communication with the controller and the imaging device. The processor may execute software to receive electronic images from the imaging device, extract at least one feature from the images, and recognize the object based on a predetermined model being applied to the extracted feature from the images. The system also includes a display device to display an indication of the recognized object from the object recognition device.
-
-
-
-
-
-
-
-
-