-
公开(公告)号:US11922729B1
公开(公告)日:2024-03-05
申请号:US18168247
申请日:2023-02-13
Applicant: Amazon Technologies, Inc.
Inventor: Kaustav Kundu , Pahal Kamlesh Dalal , Nishitkumar Ashokkumar Desai , Jayakrishnan Kumar Eledath , Geoffrey A. Franz , Gerard Guy Medioni , Hoi Cheung Pang , Rakesh Ramakrishnan
CPC classification number: G06V40/25 , G06N20/00 , G06T7/246 , G06V20/64 , G06V40/103 , G06V40/28 , G06T2207/30241
Abstract: Commercial interactions with non-discretized items such as liquids in carafes or other dispensers are detected and associated with actors using images captured by one or more digital cameras including the carafes or dispensers within their fields of view. The images are processed to detect body parts of actors and other aspects therein, and to not only determine that a commercial interaction has occurred but also identify an actor that performed the commercial interaction. Based on information or data determined from such images, movements of body parts associated with raising, lowering or rotating one or more carafes or other dispensers may be detected, and a commercial interaction involving such carafes or dispensers may be detected and associated with a specific actor accordingly.
-
公开(公告)号:US11790630B1
公开(公告)日:2023-10-17
申请号:US17401854
申请日:2021-08-13
Applicant: Amazon Technologies, Inc.
Inventor: Behjat Siddiquie , Petko Tsonev , Claire Law , Connor Spencer Blue Worley , Jue Wang , Bharat Singh , Hue Tuan Thi , Jayakrishnan Kumar Eledath , Nishitkumar Ashokkumar Desai
IPC: G06V10/40 , G06Q10/087 , G06Q30/0601 , G06V20/40
CPC classification number: G06V10/40 , G06Q10/087 , G06Q30/0633 , G06V20/40 , G06V20/44
Abstract: This disclosure describes techniques for updating planogram data associated with a facility. The planogram may indicate, for different shelves and other inventory locations within the facility, which items are on which shelves. For example, the planogram data may indicate that a particular item is located on a particular shelf. Therefore, when a system identifies that a user has taken an item from that shelf, the system may update a virtual cart of that user to indicate addition of the particular item. In some instances, however, a new item may be stocked on the example shelf instead of a previous item. The techniques described herein may use sensor data generated in the facility to identify this change and update the planogram data to indicate an association between the shelf and the new item.
-
公开(公告)号:US11494830B1
公开(公告)日:2022-11-08
申请号:US17212694
申请日:2021-03-25
Applicant: Amazon Technologies, Inc.
Inventor: Hao Jiang , Yasser Baseer Asmi , Nishitkumar Ashokkumar Desai , Emilio Ian Maldonado , Ammar Chinoy , Daniel Bibireata , Sudarshan Narasimha Raghavan
Abstract: Described is a multiple-camera system and process for determining an item involved in an event. For example, when a user picks an item or places an item at an inventory location, image information for the item may be obtained and processed to identify the item involved in the event and associate that item with the user.
-
公开(公告)号:US11468698B1
公开(公告)日:2022-10-11
申请号:US16712914
申请日:2019-12-12
Applicant: Amazon Technologies, Inc.
Inventor: Jaechul Kim , Nishitkumar Ashokkumar Desai , Jayakrishnan Kumar Eledath , Kartik Muktinutalapati , Shaonan Zhang , Hoi Cheung Pang , Dilip Kumar , Kushagra Srivastava , Gerard Guy Medioni , Daniel Bibireata
Abstract: Where an event is determined to have occurred at a location within a vicinity of a plurality of actors, imaging data captured using cameras having the location is processed using one or more machine learning systems or techniques operating on the cameras to determine which of the actors is most likely associated with the event. For each relevant pixel of each image captured by a camera, the camera returns a set of vectors extending to pixels of body parts of actors who are most likely to have been involved with an event occurring at the relevant pixel, along with a measure of confidence in the respective vectors. A server receives the vectors from the cameras, determines which of the images depicted the event in a favorable view, based at least in part on the quality of such images, and selects one of the actors as associated with the event accordingly.
-
公开(公告)号:US11468400B1
公开(公告)日:2022-10-11
申请号:US15938992
申请日:2018-03-28
Applicant: AMAZON TECHNOLOGIES, INC.
Inventor: Dilip Kumar , Liefeng Bo , Nikhil Chacko , Robert Crandall , Nishitkumar Ashokkumar Desai , Jayakrishnan Kumar Eledath , Gopi Prashanth Gopal , Gerard Guy Medioni , Paul Eugene Munger , Kushagra Srivastava
IPC: G06Q10/08 , G01G19/387 , G06N7/00 , G01G19/40
Abstract: One or more load cells measure the weight of items at a fixture. Weight changes occur as items are picked from or placed to the fixture and may be used to determine when the item was picked or placed, quantity and so forth. Individual weights for a type of item may vary. A set of data comprising weight changes associated with interactions involving a single one of a particular type of item is gathered. These may be weight changes due to picks, places, or both. A model, such as a probability distribution, may be created that relates a particular weight of that type of item to a probability. The model may then be used to process other weight changes and attempt to determine what type of item was involved in an interaction.
-
公开(公告)号:US11284041B1
公开(公告)日:2022-03-22
申请号:US15841240
申请日:2017-12-13
Applicant: Amazon Technologies, Inc.
Inventor: Alessandro Bergamo , Pahal Kamlesh Dalal , Nishitkumar Ashokkumar Desai , Jayakrishnan Kumar Eledath , Marian Nasr Amin George , Jean Laurent Guigues , Gerard Guy Medioni , Kartik Muktinutalapati , Robert Matthias Steele , Lu Xia
Abstract: In a materials handling facility, events may be associated with users based on imaging data captured from multiple fields of view. When an event is detected at a location within the fields of view of multiple cameras, two or more of the cameras may be identified as having captured images of the location at a time of the event. Users within the materials handling facility may be identified from images captured prior to, during or after the event, and visual representations of the respective actors may be generated from the images. The event may be associated with one of the users based on distances between the users' hands and the location of the event, as determined from the visual representations, or based on imaging data captured from the users' hands, which may be processed to determine which, if any, of such hands includes an item associated with the event.
-
公开(公告)号:US11263795B1
公开(公告)日:2022-03-01
申请号:US16208320
申请日:2018-12-03
Applicant: AMAZON TECHNOLOGIES, INC.
Inventor: Nishitkumar Ashokkumar Desai , Frank Florian Liberato, Jr. , I-Hung Wang , Daniel Bibireata , Muralidhar Koka
Abstract: Described are systems and techniques to generate data for display to present visualizations of data acquired from sensors in a facility. The data visualizations may be used to develop, configure, administer, or otherwise support operation of the facility. In one implementation, the visualization may include a view incorporating aggregated images acquired from multiple cameras, depth data, tracking information about objects in the facility, and so forth. An analyst may use the data visualization to determine occurrence of an action in the facility such as a pick of an item, place of an item, what item was involved with an action, what user was involved with the action, and so forth. Based on the information presented by the data visualization, changes may be made to data processing parameters.
-
公开(公告)号:US11263583B1
公开(公告)日:2022-03-01
申请号:US15939061
申请日:2018-03-28
Applicant: AMAZON TECHNOLOGIES, INC.
Inventor: Dilip Kumar , Liefeng Bo , Nikhil Chacko , Robert Crandall , Nishitkumar Ashokkumar Desai , Jayakrishnan Kumar Eledath , Gopi Prashanth Gopal , Gerard Guy Medioni , Paul Eugene Munger , Kushagra Srivastava
Abstract: Load cells measure the weight of items on a shelf. Weight changes occur as items are picked from or placed to the fixture. Information about these weight changes is used to determine an estimated location on the shelf of a weight change. Hypotheses are generated using information about where particular types of items are stowed, the weights of those particular types of items, information about the weight changes, and the estimated locations of the weight changes. A model is used to produce confidence values in the hypotheses based on a change in weight measured at a first side and a change in weight measured at a second side of the shelf. A hypothesis with a confidence value that exceeds the threshold may be selected and used to determine interaction data indicative of a quantity picked or placed, type of item, and location on the shelf.
-
公开(公告)号:US11030442B1
公开(公告)日:2021-06-08
申请号:US15841237
申请日:2017-12-13
Applicant: Amazon Technologies, Inc.
Inventor: Alessandro Bergamo , Pahal Kamlesh Dalal , Nishitkumar Ashokkumar Desai , Jayakrishnan Kumar Eledath , Marian Nasr Amin George , Jean Laurent Guigues , Gerard Guy Medioni , Kartik Muktinutalapati , Robert Matthias Steele , Lu Xia
Abstract: In a materials handling facility, events may be associated with users based on imaging data captured from multiple fields of view. When an event is detected at a location within the fields of view of multiple cameras, two or more of the cameras may be identified as having captured images of the location at a time of the event. Users within the materials handling facility may be identified from images captured prior to, during or after the event, and visual representations of the respective actors may be generated from the images. The event may be associated with one of the users based on distances between the users' hands and the location of the event, as determined from the visual representations, or based on imaging data captured from the users' hands, which may be processed to determine which, if any, of such hands includes an item associated with the event.
-
公开(公告)号:US10445593B1
公开(公告)日:2019-10-15
申请号:US15193552
申请日:2016-06-27
Applicant: AMAZON TECHNOLOGIES, INC.
Inventor: Thomas Meilandt Mathiesen , Maren Marie Costa , Nishitkumar Ashokkumar Desai , Christopher Richard Fescoe , Casey Louis Thurston , Jason Michael Famularo , Sudarshan Narasimha Raghavan , Waqas Ahmed , Danny Guan
IPC: G06K9/00 , G06T7/20 , G06F3/0481 , H04N7/18 , G06F3/0484
Abstract: Users may enter a facility singly or in groups. A user interface may be presented to an associate that includes information obtained from sensors in the facility. The associate may utilize the information presented to determine if a user is alone, or to associate that user with a particular group of users. Input from the associate obtained from this user interface may then be used by a facility management system during operation to attribute the actions of the users to a particular account.
-
-
-
-
-
-
-
-
-