公开(公告)号：US09489570B2

公开(公告)日：2016-11-08

申请号：US14145132

申请日：2013-12-31

Applicant: KONICA MINOLTA LABORATORY U.S.A., INC.

Inventor： Chen Cao ,  Yongmian Zhang ,  Haisong Gu

IPC: G06K9/00 ,  G06K9/62 ,  G06T7/00 ,  G06K9/46 ,  G06T7/20 ,  G06K9/32

CPC classification number: G06K9/00342 ,  G06K9/00369 ,  G06K9/00718 ,  G06K9/00771 ,  G06K9/3241 ,  G06K9/4642 ,  G06K9/469 ,  G06K9/6212 ,  G06T7/20 ,  G06T2207/10016 ,  G06T2207/20076 ,  G06T2207/30196

Abstract: A method and system for recognizing behavior is disclosed, the method includes: capturing at least one video stream of data on one or more subjects; extracting body skeleton data from the at least one video stream of data; computing feature extractions on the extracted body skeleton data to generate a plurality of 3 dimensional delta units for each frame of the extracted body skeleton data; generating a plurality of histogram sequences for each frame by projecting the plurality of 3 dimensional delta units for each frame to a spherical coordinate system having a plurality of spherical bins; generating an energy map for each of the plurality of histogram sequences by mapping the plurality of spherical bins versus time; applying a Histogram of Oriented Gradients (HOG) algorithm on the plurality of energy maps to generate a single column vector; and classifying the single column vector as a behavior and/or emotion.

Abstract translation: 公开了一种用于识别行为的方法和系统，所述方法包括：在一个或多个主题上捕获至少一个视频数据流; 从所述至少一个视频数据流中提取身体骨骼数据; 对所提取的身体骨骼数据进行计算特征提取，以生成所提取的身体骨骼数据的每个帧的多个3维增量单位; 通过将每个帧的多个三维三角洲单元投影到具有多个球形仓的球面坐标系统来为每个帧生成多个直方图序列; 通过将所述多个球形仓相对于时间映射来生成所述多个直方图序列中的每一个的能量图; 在多个能量图上应用定向梯度（HOG）直方图以产生单列向量; 并将单列向量分类为行为和/或情感。