SEPARATION OF OBJECTS IN IMAGES FROM THREE-DIMENSIONAL CAMERAS

    公开(公告)号:US20200342208A1

    公开(公告)日:2020-10-29

    申请号:US16923674

    申请日:2020-07-08

    Applicant: Mashgin Inc.

    Abstract: Methods, systems, and programs are presented for simultaneous recognition of objects within a detection space utilizing three-dimensional (3D) cameras configured for capturing 3D images of the detection space. One system includes the 3D cameras, calibrated based on a pattern in a surface of the detection space, a memory, and a processor. The processor combines data of the 3D images to obtain pixel data and removes, from the pixel data, background pixels of the detection space to obtain object pixel data associated with objects in the detection space. Further, the processor creates a geometric model of the object pixel data, the geometric model including surface information of the objects in the detection space, generates one or more cuts in the geometric model to separate objects and obtain respective object geometric models, and performs object recognition to identify each object in the detection space based on the respective object geometric models.

    Synchronization of image data from multiple three-dimensional cameras for image recognition

    公开(公告)号:US10467454B2

    公开(公告)日:2019-11-05

    申请号:US15497730

    申请日:2017-04-26

    Applicant: Mashgin Inc.

    Abstract: Methods, systems, and computer programs are presented for object recognition performed by electronic devices. One method includes an operation for capturing three-dimensional (3D) images of a region over a surface using 3D cameras, the surface having a pattern and each 3D camera defining a respective camera coordinate system. For each camera, the 3D image is analyzed to identify a location of the pattern indicating an origin of a common coordinate system, and a coordinate transformation function is defined to convert data to the common coordinate system. Each 3D camera captures a 3D object image of an object on the surface that includes 3D object data. The 3D object data is transformed to the common coordinate system to obtain transformed 3D object data. The 3D object data is combined to obtain a composite 3D object data, and object recognition of the object is performed based on the composite 3D object data.

    Automated object recognition kiosk for retail checkouts

    公开(公告)号:US11551287B2

    公开(公告)日:2023-01-10

    申请号:US17129296

    申请日:2020-12-21

    Applicant: Mashgin Inc.

    Inventor: Mukul Dhankhar

    Abstract: A system, method, and apparatus for automated object recognition and checkout at a retail kiosk is provided. The system includes a controller configured with a processor and a memory to control operations of the automated retail checkout system. The system further includes an imaging device in communication with the controller and configured to create multiple electronic images of an object, such as a product for purchase. The system also includes an object recognition device in communication with the controller and the imaging device. The processor may execute software to receive electronic images from the imaging device, extract at least one feature from the images, and recognize the object based on a predetermined model being applied to the extracted feature from the images. The system also includes a display device to display an indication of the recognized object from the object recognition device.

    SYSTEM AND METHOD FOR IDENTIFYING ITEMS

    公开(公告)号:US20210256724A1

    公开(公告)日:2021-08-19

    申请号:US17246409

    申请日:2021-04-30

    Applicant: Mashgin Inc.

    Abstract: The method for item recognition can include: optionally calibrating a sampling system, determining visual data using the sampling system, determining a point cloud, determining region masks based on the point cloud, generating a surface reconstruction for each item, generating image segments for each item based on the surface reconstruction, and determining a class identifier for each item using the respective image segments.

    Generation of two-dimensional and three-dimensional images of items for visual recognition in checkout apparatus

    公开(公告)号:US10540551B2

    公开(公告)日:2020-01-21

    申请号:US16180838

    申请日:2018-11-05

    Applicant: Mashgin Inc.

    Abstract: Methods, systems, and computer programs are presented for capturing color images of items for a machine-learning model. In one method, a request, for adding an item to be visually recognized during sales transactions, is detected at a checkout apparatus. Further, the method includes capturing and storing a color image, by each of one or more cameras of the checkout apparatus, of an examination space when the item is present. Further, the capturing and storing of color images of the item is repeated at different poses until at a predetermined number of color images of the item are captured. Further, the method includes generating, by a processor of the checkout apparatus, additional images of the item by modifying the captured color images. A machine-learning model for item recognition is built by training a machine-learning tool with the captured images and the additional images.

    FEEDBACK LOOP FOR IMAGE-BASED RECOGNITION
    19.
    发明申请

    公开(公告)号:US20190236360A1

    公开(公告)日:2019-08-01

    申请号:US15883355

    申请日:2018-01-30

    Applicant: Mashgin Inc.

    Abstract: Methods, systems, and computer programs are presented for providing a feedback loop to improve object image-based recognition based on transaction data. In one method, instructions are received defining items to be visually recognized by a terminal. For each item, a check is made to determine if item image information is in a global database or if it is a new item. The global database includes item images captured during transactions performed at several terminals. For each item in the global database, item image information is downloaded from the global database. For new items, terminal cameras capture pose images for several poses of the new items, each camera taking an image for each pose. A machine-learning program is trained with the downloaded image information and the pose images, where the machine-learning program performs image-based recognition of the items that are presented at the terminal, based on images captured by the cameras.

    Automated object recognition kiosk for retail checkouts

    公开(公告)号:US10366445B2

    公开(公告)日:2019-07-30

    申请号:US14517634

    申请日:2014-10-17

    Applicant: MASHGIN INC.

    Inventor: Mukul Dhankhar

    Abstract: A system, method, and apparatus for automated object recognition and checkout at a retail kiosk is provided. The system includes a controller configured with a processor and a memory to control operations of the automated retail checkout system. The system further includes an imaging device in communication with the controller and configured to create multiple electronic images of an object, such as a product for purchase. The system also includes an object recognition device in communication with the controller and the imaging device. The processor may execute software to receive electronic images from the imaging device, extract at least one feature from the images, and recognize the object based on a predetermined model being applied to the extracted feature from the images. The system also includes a display device to display an indication of the recognized object from the object recognition device.

Patent Agency Ranking