-
公开(公告)号:US11468681B1
公开(公告)日:2022-10-11
申请号:US16022221
申请日:2018-06-28
Applicant: Amazon Technologies, Inc.
Inventor: Dilip Kumar , Jaechul Kim , Kushagra Srivastava , Nishitkumar Ashokkumar Desai , Jayakrishnan Kumar Eledath , Gerard Guy Medioni , Daniel Bibireata
Abstract: Where an event is determined to have occurred at a location within a vicinity of a plurality of actors, imaging data captured using cameras having the location is processed using one or more machine learning systems or techniques operating on the cameras to determine which of the actors is most likely associated with the event. For each relevant pixel of each image captured by a camera, the camera returns a set of vectors extending to pixels of body parts of actors who are most likely to have been involved with an event occurring at the relevant pixel, along with a measure of confidence in the respective vectors. A server receives the sets of vectors from the cameras, determines which of the images depicted the event in a favorable view, based at least in part on the quality of such images, and selects one of the actors as associated with the event accordingly.
-
公开(公告)号:US11093785B1
公开(公告)日:2021-08-17
申请号:US16455099
申请日:2019-06-27
Applicant: Amazon Technologies, Inc.
Inventor: Behjat Siddiquie , Petko Tsonev , Claire Law , Connor Spencer Blue Worley , Jue Wang , Bharat Singh , Hue Tuan Thi , Jayakrishnan Kumar Eledath , Nishitkumar Ashokkumar Desai
Abstract: This disclosure describes techniques for updating planogram data associated with a facility. The planogram may indicate, for different shelves and other inventory locations within the facility, which items are on which shelves. For example, the planogram data may indicate that a particular item is located on a particular shelf. Therefore, when a system identifies that a user has taken an item from that shelf, the system may update a virtual cart of that user to indicate addition of the particular item. In some instances, however, a new item may be stocked on the example shelf instead of a previous item. The techniques described herein may use sensor data generated in the facility to identify this change and update the planogram data to indicate an association between the shelf and the new item.
-
公开(公告)号:US11922728B1
公开(公告)日:2024-03-05
申请号:US18049252
申请日:2022-10-24
Applicant: Amazon Technologies, Inc.
Inventor: Jaechul Kim , Nishitkumar Ashokkumar Desai , Jayakrishnan Kumar Eledath , Kartik Muktinutalapati , Shaonan Zhang , Hoi Cheung Pang , Dilip Kumar , Kushagra Srivastava , Gerard Guy Medioni , Daniel Bibireata
IPC: G06V40/20 , G06F17/16 , G06F18/2321 , G06N3/08 , G06N20/00 , G06Q30/0201 , G06V20/10 , G06V20/52
CPC classification number: G06V40/20 , G06F17/16 , G06F18/2321 , G06N3/08 , G06N20/00 , G06Q30/0201 , G06V20/10 , G06V20/52
Abstract: Where an event is determined to have occurred at a location within a vicinity of a plurality of actors, imaging data captured using cameras having the location is processed using one or more machine learning systems or techniques operating on the cameras to determine which of the actors is most likely associated with the event. For each relevant pixel of each image captured by a camera, the camera returns a set of vectors extending to pixels of body parts of actors who are most likely to have been involved with an event occurring at the relevant pixel, along with a measure of confidence in the respective vectors. A server receives the vectors from the cameras, determines which of the images depicted the event in a favorable view, based at least in part on the quality of such images, and selects one of the actors as associated with the event accordingly.
-
公开(公告)号:US11580785B1
公开(公告)日:2023-02-14
申请号:US16436500
申请日:2019-06-10
Applicant: Amazon Technologies, Inc.
Inventor: Kaustav Kundu , Pahal Kamlesh Dalal , Nishitkumar Ashokkumar Desai , Jayakrishnan Kumar Eledath , Geoffrey A. Franz , Gerard Guy Medioni , Hoi Cheung Pang , Rakesh Ramakrishnan
Abstract: Commercial interactions with non-discretized items such as liquids in carafes or other dispensers are detected and associated with actors using images captured by one or more digital cameras including the carafes or dispensers within their fields of view. The images are processed to detect body parts of actors and other aspects therein, and to not only determine that a commercial interaction has occurred but also identify an actor that performed the commercial interaction. Based on information or data determined from such images, movements of body parts associated with raising, lowering or rotating one or more carafes or other dispensers may be detected, and a commercial interaction involving such carafes or dispensers may be detected and associated with a specific actor accordingly.
-
公开(公告)号:US11436557B1
公开(公告)日:2022-09-06
申请号:US15939063
申请日:2018-03-28
Applicant: AMAZON TECHNOLOGIES, INC.
Inventor: Dilip Kumar , Liefeng Bo , Nikhil Chacko , Robert Crandall , Nishitkumar Ashokkumar Desai , Jayakrishnan Kumar Eledath , Gopi Prashanth Gopal , Gerard Guy Medioni , Paul Eugene Munger , Kushagra Srivastava
IPC: G06Q10/08 , G01G19/387 , G06N7/00 , G01G19/40
Abstract: One or more load cells measure the weight of items on a shelf or other fixture. Weight changes occur as items are picked from or placed to the fixture. Output from the load cells is processed to produce denoised data. The denoised data is processed to determine event data representative of a pick or a place of an item. Hypotheses are generated using information about where particular types of items are stowed, the weights of those particular types of items, and the event data. A high scoring hypothesis is used to determine interaction data indicative of the type and quantity of an item that was added to or removed from the fixture. If ambiguity exists between hypotheses, additional techniques such as data about locations of weight changes and fine grained analysis may be used to determine the interaction data.
-
公开(公告)号:US11308442B1
公开(公告)日:2022-04-19
申请号:US15939080
申请日:2018-03-28
Applicant: AMAZON TECHNOLOGIES, INC.
Inventor: Dilip Kumar , Liefeng Bo , Nikhil Chacko , Robert Crandall , Nishitkumar Ashokkumar Desai , Jayakrishnan Kumar Eledath , Gopi Prashanth Gopal , Gerard Guy Medioni , Paul Eugene Munger , Kushagra Srivastava
IPC: G06Q10/08 , G01G19/387 , B65G1/137 , G01G19/42 , G06Q20/20
Abstract: Sensor data from load cells at a shelf is processed using a first time window to produce first event data describing coarse and sub-events. Location data is determined that indicates where on the shelf weight changes occurred at particular times. Hypotheses are generated using information about where items are stowed, weights of those of items, type of event, and the location data. If confidence values of these hypotheses are below a threshold value, second event data is determined by merging adjacent sub-events. This second event data is then used to determine second hypotheses which are then assessed. A hypothesis with a high confidence value is used to generate interaction data indicative of picks or places of particular quantities of particular types of items from the shelf.
-
公开(公告)号:US11301684B1
公开(公告)日:2022-04-12
申请号:US15839734
申请日:2017-12-12
Applicant: Amazon Technologies, Inc.
Inventor: Dilip Kumar , Liefeng Bo , Keunhong Park , Gerard Guy Medioni , Nikhil Chacko , Jayakrishnan Kumar Eledath , Nishitkumar Ashokkumar Desai
IPC: G06K9/00
Abstract: This disclosure describes systems and techniques for detecting certain activity in image data, such as frames of video data. For example, the systems and techniques may create and utilize an activity classifier for detecting and classifying certain human activity in video data of a facility. In some instances, the classifier may be trained to identify, from the video data, certain predefined activity such as a user picking an item from a shelf, a user returning an item to a shelf, a first user passing an item to a second user, or the like. In some instances, the techniques enable activity detection using only video data, rather than in addition to data acquired by other sensors.
-
公开(公告)号:US11922729B1
公开(公告)日:2024-03-05
申请号:US18168247
申请日:2023-02-13
Applicant: Amazon Technologies, Inc.
Inventor: Kaustav Kundu , Pahal Kamlesh Dalal , Nishitkumar Ashokkumar Desai , Jayakrishnan Kumar Eledath , Geoffrey A. Franz , Gerard Guy Medioni , Hoi Cheung Pang , Rakesh Ramakrishnan
CPC classification number: G06V40/25 , G06N20/00 , G06T7/246 , G06V20/64 , G06V40/103 , G06V40/28 , G06T2207/30241
Abstract: Commercial interactions with non-discretized items such as liquids in carafes or other dispensers are detected and associated with actors using images captured by one or more digital cameras including the carafes or dispensers within their fields of view. The images are processed to detect body parts of actors and other aspects therein, and to not only determine that a commercial interaction has occurred but also identify an actor that performed the commercial interaction. Based on information or data determined from such images, movements of body parts associated with raising, lowering or rotating one or more carafes or other dispensers may be detected, and a commercial interaction involving such carafes or dispensers may be detected and associated with a specific actor accordingly.
-
公开(公告)号:US11790630B1
公开(公告)日:2023-10-17
申请号:US17401854
申请日:2021-08-13
Applicant: Amazon Technologies, Inc.
Inventor: Behjat Siddiquie , Petko Tsonev , Claire Law , Connor Spencer Blue Worley , Jue Wang , Bharat Singh , Hue Tuan Thi , Jayakrishnan Kumar Eledath , Nishitkumar Ashokkumar Desai
IPC: G06V10/40 , G06Q10/087 , G06Q30/0601 , G06V20/40
CPC classification number: G06V10/40 , G06Q10/087 , G06Q30/0633 , G06V20/40 , G06V20/44
Abstract: This disclosure describes techniques for updating planogram data associated with a facility. The planogram may indicate, for different shelves and other inventory locations within the facility, which items are on which shelves. For example, the planogram data may indicate that a particular item is located on a particular shelf. Therefore, when a system identifies that a user has taken an item from that shelf, the system may update a virtual cart of that user to indicate addition of the particular item. In some instances, however, a new item may be stocked on the example shelf instead of a previous item. The techniques described herein may use sensor data generated in the facility to identify this change and update the planogram data to indicate an association between the shelf and the new item.
-
公开(公告)号:US11468698B1
公开(公告)日:2022-10-11
申请号:US16712914
申请日:2019-12-12
Applicant: Amazon Technologies, Inc.
Inventor: Jaechul Kim , Nishitkumar Ashokkumar Desai , Jayakrishnan Kumar Eledath , Kartik Muktinutalapati , Shaonan Zhang , Hoi Cheung Pang , Dilip Kumar , Kushagra Srivastava , Gerard Guy Medioni , Daniel Bibireata
Abstract: Where an event is determined to have occurred at a location within a vicinity of a plurality of actors, imaging data captured using cameras having the location is processed using one or more machine learning systems or techniques operating on the cameras to determine which of the actors is most likely associated with the event. For each relevant pixel of each image captured by a camera, the camera returns a set of vectors extending to pixels of body parts of actors who are most likely to have been involved with an event occurring at the relevant pixel, along with a measure of confidence in the respective vectors. A server receives the vectors from the cameras, determines which of the images depicted the event in a favorable view, based at least in part on the quality of such images, and selects one of the actors as associated with the event accordingly.
-
-
-
-
-
-
-
-
-