-
公开(公告)号:US11922728B1
公开(公告)日:2024-03-05
申请号:US18049252
申请日:2022-10-24
Applicant: Amazon Technologies, Inc.
Inventor: Jaechul Kim , Nishitkumar Ashokkumar Desai , Jayakrishnan Kumar Eledath , Kartik Muktinutalapati , Shaonan Zhang , Hoi Cheung Pang , Dilip Kumar , Kushagra Srivastava , Gerard Guy Medioni , Daniel Bibireata
IPC: G06V40/20 , G06F17/16 , G06F18/2321 , G06N3/08 , G06N20/00 , G06Q30/0201 , G06V20/10 , G06V20/52
CPC classification number: G06V40/20 , G06F17/16 , G06F18/2321 , G06N3/08 , G06N20/00 , G06Q30/0201 , G06V20/10 , G06V20/52
Abstract: Where an event is determined to have occurred at a location within a vicinity of a plurality of actors, imaging data captured using cameras having the location is processed using one or more machine learning systems or techniques operating on the cameras to determine which of the actors is most likely associated with the event. For each relevant pixel of each image captured by a camera, the camera returns a set of vectors extending to pixels of body parts of actors who are most likely to have been involved with an event occurring at the relevant pixel, along with a measure of confidence in the respective vectors. A server receives the vectors from the cameras, determines which of the images depicted the event in a favorable view, based at least in part on the quality of such images, and selects one of the actors as associated with the event accordingly.
-
公开(公告)号:US11688170B2
公开(公告)日:2023-06-27
申请号:US17106755
申请日:2020-11-30
Applicant: Amazon Technologies, Inc.
Inventor: Ivan Stankovic , Joseph M Alyea , Jiajun Zhao , Kartik Muktinutalapati , Waqas Ahmed , Dilip Kumar , Danny Guan , Nishitkumar Ashokkumar Desai , Longlong Zhu
CPC classification number: G06V20/52 , G06F18/2163 , G06F18/24 , G06K7/1413 , G06Q30/0633 , G06T7/70 , G06V10/25 , G06V40/107 , G06T2207/30196 , G06T2207/30232
Abstract: This disclosure is directed to techniques in which a first user in an environment scans visual indicia associated with an item, such as a barcode, before handing the item to a second user. One or more computing devices may receive an indication of the scan, retrieve image data of the interaction from a camera within the environment, identify the user that received the item, and update a virtual cart associated with the second user to indicate addition of the item.
-
公开(公告)号:US11580785B1
公开(公告)日:2023-02-14
申请号:US16436500
申请日:2019-06-10
Applicant: Amazon Technologies, Inc.
Inventor: Kaustav Kundu , Pahal Kamlesh Dalal , Nishitkumar Ashokkumar Desai , Jayakrishnan Kumar Eledath , Geoffrey A. Franz , Gerard Guy Medioni , Hoi Cheung Pang , Rakesh Ramakrishnan
Abstract: Commercial interactions with non-discretized items such as liquids in carafes or other dispensers are detected and associated with actors using images captured by one or more digital cameras including the carafes or dispensers within their fields of view. The images are processed to detect body parts of actors and other aspects therein, and to not only determine that a commercial interaction has occurred but also identify an actor that performed the commercial interaction. Based on information or data determined from such images, movements of body parts associated with raising, lowering or rotating one or more carafes or other dispensers may be detected, and a commercial interaction involving such carafes or dispensers may be detected and associated with a specific actor accordingly.
-
公开(公告)号:US11436557B1
公开(公告)日:2022-09-06
申请号:US15939063
申请日:2018-03-28
Applicant: AMAZON TECHNOLOGIES, INC.
Inventor: Dilip Kumar , Liefeng Bo , Nikhil Chacko , Robert Crandall , Nishitkumar Ashokkumar Desai , Jayakrishnan Kumar Eledath , Gopi Prashanth Gopal , Gerard Guy Medioni , Paul Eugene Munger , Kushagra Srivastava
IPC: G06Q10/08 , G01G19/387 , G06N7/00 , G01G19/40
Abstract: One or more load cells measure the weight of items on a shelf or other fixture. Weight changes occur as items are picked from or placed to the fixture. Output from the load cells is processed to produce denoised data. The denoised data is processed to determine event data representative of a pick or a place of an item. Hypotheses are generated using information about where particular types of items are stowed, the weights of those particular types of items, and the event data. A high scoring hypothesis is used to determine interaction data indicative of the type and quantity of an item that was added to or removed from the fixture. If ambiguity exists between hypotheses, additional techniques such as data about locations of weight changes and fine grained analysis may be used to determine the interaction data.
-
公开(公告)号:US11412185B1
公开(公告)日:2022-08-09
申请号:US17128774
申请日:2020-12-21
Applicant: AMAZON TECHNOLOGIES, INC.
Inventor: Emilio Ian Maldonado , Daniel Bibireata , Nishitkumar Ashokkumar Desai , Yasser Baseer Asmi , Xiaofeng Ren , Jaechul Kim
Abstract: Sensors in a facility generate sensor data associated with a region of the facility, which can be used to determine a 3D location of an object in the facility. Some sensors may sense overlapping regions of the facility. For example, a first sensor may generate data associated with a first region of the facility, while a second sensor may generate data associated with a second region of the facility that partially overlaps the first region. Sensors may fail at times as determined from sensor output data or status data. In response to identifying a failed sensor, an undetected region corresponding to the failed sensor is identified, as well as a substitute sensor that partially senses the undetected region. Sensor data from the substitute sensor, such as 2D data, is acquired and used to estimate a 3D location of an object in the undetected region.
-
公开(公告)号:US11308442B1
公开(公告)日:2022-04-19
申请号:US15939080
申请日:2018-03-28
Applicant: AMAZON TECHNOLOGIES, INC.
Inventor: Dilip Kumar , Liefeng Bo , Nikhil Chacko , Robert Crandall , Nishitkumar Ashokkumar Desai , Jayakrishnan Kumar Eledath , Gopi Prashanth Gopal , Gerard Guy Medioni , Paul Eugene Munger , Kushagra Srivastava
IPC: G06Q10/08 , G01G19/387 , B65G1/137 , G01G19/42 , G06Q20/20
Abstract: Sensor data from load cells at a shelf is processed using a first time window to produce first event data describing coarse and sub-events. Location data is determined that indicates where on the shelf weight changes occurred at particular times. Hypotheses are generated using information about where items are stowed, weights of those of items, type of event, and the location data. If confidence values of these hypotheses are below a threshold value, second event data is determined by merging adjacent sub-events. This second event data is then used to determine second hypotheses which are then assessed. A hypothesis with a high confidence value is used to generate interaction data indicative of picks or places of particular quantities of particular types of items from the shelf.
-
公开(公告)号:US11301684B1
公开(公告)日:2022-04-12
申请号:US15839734
申请日:2017-12-12
Applicant: Amazon Technologies, Inc.
Inventor: Dilip Kumar , Liefeng Bo , Keunhong Park , Gerard Guy Medioni , Nikhil Chacko , Jayakrishnan Kumar Eledath , Nishitkumar Ashokkumar Desai
IPC: G06K9/00
Abstract: This disclosure describes systems and techniques for detecting certain activity in image data, such as frames of video data. For example, the systems and techniques may create and utilize an activity classifier for detecting and classifying certain human activity in video data of a facility. In some instances, the classifier may be trained to identify, from the video data, certain predefined activity such as a user picking an item from a shelf, a user returning an item to a shelf, a first user passing an item to a second user, or the like. In some instances, the techniques enable activity detection using only video data, rather than in addition to data acquired by other sensors.
-
公开(公告)号:US10963949B1
公开(公告)日:2021-03-30
申请号:US16595124
申请日:2019-10-07
Applicant: Amazon Technologies, Inc.
Inventor: Hao Jiang , Yasser Baseer Asmi , Nishitkumar Ashokkumar Desai , Emilio Ian Maldonado , Ammar Chinoy , Daniel Bibireata , Sudarshan Narasimha Raghavan
Abstract: Described is a multiple-camera system and process for determining an item involved in an event. For example, when a user picks an item or places an item at an inventory location, image information for the item may be obtained and processed to identify the item involved in the event and associate that item with the user.
-
公开(公告)号:US10475185B1
公开(公告)日:2019-11-12
申请号:US14581992
申请日:2014-12-23
Applicant: Amazon Technologies, Inc.
Inventor: Sudarshan Narasimha Raghavan , Emilio Ian Maldonado , Dilip Kumar , Daniel Bibireata , Ammar Chinoy , Nishitkumar Ashokkumar Desai
Abstract: Described is a multiple-camera system and process for identifying a user that performed an event and associating that user with the event. For example, when an event is detected, user patterns near the location of the event are determined, along with touch points at the location of the event. User pattern orientation and/or arm trajectories between the event location and the user pattern may be determined and processed to link the user pattern to the event, thereby confirming the association between the event and the user.
-
公开(公告)号:US12079770B1
公开(公告)日:2024-09-03
申请号:US18052182
申请日:2022-11-02
Applicant: Amazon Technologies, Inc.
Inventor: Hao Jiang , Yasser Baseer Asmi , Nishitkumar Ashokkumar Desai , Emilio Ian Maldonado , Ammar Chinoy , Daniel Bibireata , Sudarshan Narasimha Raghavan
IPC: G06Q10/087 , G06Q30/0601 , G06V10/40 , G06V20/10 , G06V20/52 , G06V40/10 , G06V40/20 , G06V20/40 , G06V40/16
CPC classification number: G06Q10/087 , G06Q30/0635 , G06V10/40 , G06V20/10 , G06V20/52 , G06V40/103 , G06V40/28 , G06V20/44 , G06V40/172
Abstract: Described is a multiple-camera system and process for determining an item involved in an event. For example, when a user picks an item or places an item at an inventory location, image information for the item may be obtained and processed to identify the item involved in the event and associate that item with the user.
-
-
-
-
-
-
-
-
-