Abstract:
A method, computer readable storage medium, and system are disclosed for improving communication productivity, comprising: capturing at least one three-dimensional (3D) stream of data on two or more subjects; extracting a time-series of skeletal data from the at least one 3D stream of data on the two or more subjects; and determining an engagement index between the two or more subjects by comparing the time-series of skeletal data on each of the two or more subjects over a time window.
Abstract:
A method for 3D gesture behavior recognition is disclosed, which includes detecting a behavior change of one or more attendees at a meeting and/or conference; classifying the behavior change; and performing an action based on the behavior change of the one or more attendees. Another method, system and computer readable medium for 3D gesture behavior recognition as disclosed, includes obtaining temporal segmentation of human motion sequences for one or more attendees; determining a probability density function of the temporal segmentations of the human motion sequences using a Parzen window density estimation model; computing a bandwidth for determination of a median absolute deviation; updating the Parzen window to adapt for changes in the motion sequences for the one or more attendees; and detecting actions based.
Abstract:
A method, system and non-transitory computer readable medium are disclosed for recognizing gestures, the method includes capturing at least one three-dimensional (3D) video stream of data on a subject; extracting a time-series of skeletal data from the at least one 3D video stream of data; isolating a plurality of points of abrupt content change called temporal cuts, the plurality of temporal cuts defining a set of non-overlapping adjacent segments partitioning the time-series of skeletal data; identifying among the plurality of temporal cuts, temporal cuts of the time-series of skeletal data having a positive acceleration; and classifying each of the one or more pair of consecutive cuts with the positive acceleration as a gesture boundary.
Abstract:
A method and system are disclosed for recognizing an object, the method including emitting one or more arranged patterns of infrared rays (IR) from an infrared emitter towards a projection region, the one or more arranged patterns of infrared rays forming unique dot patterns; mapping the one or more arranged patterns of infrared rays on the operation region to generate a reference image; capturing an IR image and a RGB image of an object with a wearable device, the wearable device including an infrared (IR) camera and a RGB camera; extracting IR dots from the IR image and determining a match between the extracted IR dots and the reference image; determining a position of the RGB image on the reference image; and mapping the position of the RGB image to a coordinate on the projection region.
Abstract:
A method and system for recognizing behavior is disclosed, the method includes: capturing at least one video stream of data on one or more subjects; extracting body skeleton data from the at least one video stream of data; computing feature extractions on the extracted body skeleton data to generate a plurality of 3 dimensional delta units for each frame of the extracted body skeleton data; generating a plurality of histogram sequences for each frame by projecting the plurality of 3 dimensional delta units for each frame to a spherical coordinate system having a plurality of spherical bins; generating an energy map for each of the plurality of histogram sequences by mapping the plurality of spherical bins versus time; applying a Histogram of Oriented Gradients (HOG) algorithm on the plurality of energy maps to generate a single column vector; and classifying the single column vector as a behavior and/or emotion.
Abstract:
A method, a non-transitory computer readable medium, and a system are disclosed for observing one or more subjects. The method includes monitoring a space with at least one master sensor, wherein a plurality of secondary sensors are installed in the space, and wherein a number of the at least one master sensor is less than a number of the plurality of secondary sensors; detecting regions of interest based on input from the at least one master sensor; identifying one or more secondary sensors from the plurality of secondary sensors in the detected regions of interest; and recognizing activities in the detected regions of interest from the one or more secondary sensors.
Abstract:
A method, computer readable medium, and system are disclosed of enhancing cell images for analysis. The method includes performing a multi-thresholding process on a cell image to generate a plurality of images of the cell image; smoothing each component within each of the plurality of images; merging the smoothed components into a merger layer; classifying each of the components of the merged layer into convex cell regions and concave cell regions; combining the concave cell regions with a cell boundary for each of the corresponding concave cell regions to generate a smoothed shape profile for each of the concave cell regions; and generating an output image by combining the convex cell regions with the concave cell regions with smoothed shape profiles.
Abstract:
A method, computer readable storage medium, and system are disclosed for improving communication productivity in a conference between two or more subjects, wherein at least one of the two or more subjects participates in the conference from a first location and one or more of the two or more subjects participate in the meeting from a second location. The method includes capturing, at least one first three-dimensional (3D) stream of data and at least one second three-dimensional (3D) stream of data on each of the two or more subjects participating in the conference; generating a synchrony score for the two or more subjects, wherein the synchrony score is calculated by comparing time series of skeletal data of each of the two or more subjects to one another for a defined period of time; and using the synchrony score to generate an engagement index between the two or more subjects.
Abstract:
A method is disclosed for detecting interaction between two or more participants in a meeting, which includes capturing at least one three-dimensional stream of data on the two or more participants; extracting a time-series of skeletal data from the at least one three-dimensional stream of data on the two or more participants; classifying the time-series of skeletal data for each of the two or more participants based on a plurality of body position classifiers; and calculating an engagement score for each of the two or more participants. In addition, a method is disclosed for improving a group interaction in a meeting, which includes calculating, for each of the two or more participants, an individual engagement state based on attitudes of the participant, wherein the individual engagement state is an engagement state of the participant to the meeting including an engaged state and a disengaged state.
Abstract:
A method, a computer readable medium, and a system are disclosed for cell segmentation. The method including generating a binary mask from an input image of a plurality of cells, wherein the binary mask separates foreground cells from a background; classifying each of the cell regions of the binary mask into single cell regions, small cluster regions, and large cluster regions; performing, on each of the small cluster regions, a segmentation based on a contour shape of the small cluster region; performing, on each of the large cluster regions, a segmentation based on a texture in the large cluster regions; and outputting an image with cell boundaries.