公开(公告)号：US20140323888A1

公开(公告)日：2014-10-30

申请号：US13871766

申请日：2013-04-26

Applicant: XEROX CORPORATION

Inventor： Survi KYAL ,  Lalit Keshav MESTHA ,  Beilei XU

IPC: A61B5/024 ,  G06T7/00

CPC classification number: A61B5/02405 ,  A61B5/021 ,  A61B5/02416 ,  A61B5/02444 ,  A61B5/0295 ,  A61B5/7225

Abstract: What is disclosed is a system and method for extracting photoplethysmographic (PPG) signal (i.e., a cardiac signal) on a continuous basis from a time-series signals obtained from video images captured of a subject being monitored for cardiac function in a non-contact remote sensing environment involves the following. First, a time-series signal obtained from video images captured of a region of exposed skin where a photoplethysmographic (PPG) signal of a subject of interest can be registered. A sliding window is then used to define consecutive sequential segments of the time-series signal for processing. Each of the consecutive time-series signal segments is detrended such that low frequency variations and non-stationary components are removed. The detrended signals are processed to obtain, for each segment, a PPG signal. The PPG signal segments are then stitched together using a stitching method, as disclosed herein, to obtain a continuous PPG signal for the subject.

Abstract translation: 公开的是一种系统和方法，用于连续地从从非接触的心脏功能监测对象被摄取的视频图像获得的时间序列信号中连续提取光电体积描记（即心脏信号） 遥感环境涉及以下几个方面。 首先，可以登记拍摄感兴趣对象的光电体描记（PPG）信号的暴露皮肤区域的视频图像获得的时间序列信号。 然后使用滑动窗口来定义用于处理的时间序列信号的连续的顺序段。 每个连续的时间序列信号段被去除，使得低频变化和非固定分量被去除。 处理去信号的信号，以获得每个段的PPG信号。 然后如本文所公开的，使用缝合方法将PPG信号段缝合在一起，以获得该对象的连续PPG信号。

公开(公告)号：US20140205175A1

公开(公告)日：2014-07-24

申请号：US13745283

申请日：2013-01-18

Applicant: XEROX CORPORATION

Inventor： Takashi TANAKA ,  Lalit Keshav MESTHA

IPC: G06T5/00

CPC classification number: G06T5/007 ,  G01J3/0248 ,  G01J3/0264 ,  G01J2003/2826 ,  G06T2207/10016 ,  G06T2207/10024 ,  G06T2207/30004

Abstract: What is disclosed is a system and method for real-time enhancement of an identified time-series signal of interest in a video that has a similar spatial and temporal structure to a given reference signal, as determined by a measure of closeness. A closeness measure is computed for pixels of each image frame of each channel of a multi-channel video to identify a time-series signal of interest. The intensity of pixels associated with that time-series signal is modified based on a product of the closeness measure and the reference signal scaled by an amplification factor. The modified pixel intensity values are provided back into the source video to generate a reconstructed video such that, upon playback of the reconstructed video, viewers thereof can visually examine the amplified time-series signal, see how it is distributed and how it propagates. The methods disclosed find their uses in remote sensing applications such as telemedicine.

Abstract translation: 所公开的是用于实时增强视频中所识别的时间序列信号的系统和方法，该视频具有与给定参考信号相似的空间和时间结构，如由接近程度所确定的。 为多通道视频的每个通道的每个图像帧的像素计算接近度量，以识别感兴趣的时间序列信号。 与该时间序列信号相关联的像素的强度基于通过放大因子缩放的接近度测量和参考信号的乘积而被修改。 修改的像素强度值被提供回到源视频中以产生重构的视频，使得在重建视频时，其观看者可以在视觉上检查放大的时间序列信号，看看它是如何分布的以及它如何传播的。 所公开的方法可用于遥感应用，如远程医疗。

公开(公告)号：US20170055920A1

公开(公告)日：2017-03-02

申请号：US14837898

申请日：2015-08-27

Applicant: Xerox Corporation

Inventor： Lalit Keshav MESTHA ,  Sanjay BHARADWAJ ,  Prathosh A. PRASAD ,  Tejaskumar D. BENGALI ,  Himanshu J. MADHU ,  Suresh KUPPUSWAMY

IPC: A61B5/00 ,  A61B5/113 ,  A61B5/11

CPC classification number: A61B5/7285 ,  A61B5/0013 ,  A61B5/0075 ,  A61B5/0077 ,  A61B5/1128 ,  A61B5/113 ,  A61B5/1135 ,  A61B5/4836 ,  A61B5/725 ,  A61B5/7264 ,  A61B5/7292 ,  A61B6/00 ,  A61B6/025 ,  A61B6/032 ,  A61B6/037 ,  A61B6/541 ,  A61B2576/02 ,  G06T7/246 ,  G06T2207/20076 ,  G06T2207/30004

Abstract: What is disclosed is a system and method for generating a respiration gating signal from a video of a subject for gating diagnostic imaging and therapeutic delivery applications which require respiration phase and/or respiration amplitude gating. One embodiment involves receiving a video of a subject and generating a plurality of time-series signals from the video image frames. A set of features are extracted from the time-series signals and multi-dimensional feature vectors are formed. The feature vectors are clustered. Time-series signals corresponding in each of the clusters are averaged in a temporal direction to obtain a representative signal for each cluster. One cluster is selected and a respiration gating signal is generated from that cluster's representative signal. Thereafter, the respiration gating signal is used to gate diagnostic imaging and therapeutic delivery applications which requires gating based on a threshold set with respect to either respiration phase or respiration amplitude.

Abstract translation: 公开的是用于从需要呼吸相位和/或呼吸振幅选通的门诊诊断成像和治疗递送应用的对象视频产生呼吸门控信号的系统和方法。 一个实施例涉及接收对象的视频并从视频图像帧产生多个时间序列信号。 从时间序列信号中提取一组特征，形成多维特征向量。 特征向量是聚类的。 在每个簇中对应的时间序列信号在时间方向上被平均以获得每个簇的代表信号。 选择一个群集，并从该群集的代表信号中生成呼吸门控信号。 此后，呼吸门控信号用于门诊诊断成像和治疗递送应用，其需要基于相对于呼吸相位或呼吸振幅设定的阈值进行门控。

公开(公告)号：US20160287106A1

公开(公告)日：2016-10-06

申请号：US14674868

申请日：2015-03-31

Applicant: Xerox Corporation

Inventor： Lalit Keshav MESTHA ,  Luisa Fernanda POLANIA-CABRERA

IPC: A61B5/024 ,  A61B5/00

CPC classification number: A61B5/02416 ,  A61B5/7225 ,  A61B5/7264 ,  A61B5/7275 ,  A61B5/7282 ,  G16H50/30

Abstract: What is disclosed is a system and method for assessing risk for ventricular tachycardia from a time-series signal of a patient monitored for cardiac function assessment. One embodiment involves receiving a time-series signal which contains frequency components that relate to the function of the subject's heart. Signal segments of interest are identified in the time-series signal. Time-domain features are extracted for each signal segment of interest. The time-domain features are arranged into a two dimensional feature vector. Each feature vector is associated with a respective signal segment. A magnitude of each signal segment's respective feature vector is determined. Signal segments are classified as being ventricular premature contraction based on each segment's associated magnitude. If at least three consecutive signal segments or at least three consecutive portions of the same signal segment have been classified as ventricular premature contraction, then the subject's risk of a ventricular tachycardia is assessed as elevated.

Abstract translation: 所公开的是用于评估监测用于心脏功能评估的患者的时间序列信号的室性心动过速风险的系统和方法。 一个实施例涉及接收包含与被摄体心脏的功能相关的频率分量的时间序列信号。 感兴趣的信号段在时间序列信号中被识别。 为感兴趣的每个信号段提取时域特征。 将时域特征排列成二维特征向量。 每个特征向量与相应的信号段相关联。 确定每个信号段的各个特征向量的大小。 信号段被分类为基于每个段的相关大小的心室过早收缩。 如果相同信号段的至少三个连续的信号片段或至少三个连续的部分被分类为心室过早收缩，则将患者的室性心动过速的风险评估为升高。

公开(公告)号：US20160086341A1

公开(公告)日：2016-03-24

申请号：US14958157

申请日：2015-12-03

Applicant: Xerox Corporation

Inventor： Edgar A. BERNAL ,  Wencheng WU ,  Lalit Keshav MESTHA

IPC: G06T7/00 ,  G06K9/46

CPC classification number: G06K9/4604 ,  G06T7/11 ,  G06T7/521 ,  G06T7/593 ,  G06T2207/10016 ,  G06T2207/10024 ,  G06T2207/20004 ,  G06T2207/20104 ,  G06T2207/30201

Abstract: What is disclosed is a system and method for adaptively reconstructing a depth map of a scene. In one embodiment, upon receiving a mask identifying a region of interest (ROI), a processor changes either a spatial attribute of a pattern of source light projected on the scene by a light modulator which projects an undistorted pattern of light with known spatio-temporal attributes on the scene, or changes an operative resolution of a depth map reconstruction module. A sensing device detects the reflected pattern of light. A depth map of the scene is generated by the depth map reconstruction module by establishing correspondences between spatial attributes in the detected pattern and spatial attributes of the projected undistorted pattern and triangulating the correspondences to characterize differences therebetween. The depth map is such that a spatial resolution in the ROI is higher relative to a spatial resolution of locations not within the ROI.

公开(公告)号：US20140378842A1

公开(公告)日：2014-12-25

申请号：US13921939

申请日：2013-06-19

Applicant: Xerox Corporation

Inventor： Beilei XU ,  Lalit Keshav MESTHA ,  Survi KYAL ,  Himanshu J. MADHU

IPC: A61B5/00

CPC classification number: A61B5/0077 ,  A61B5/0205 ,  A61B5/7221 ,  A61B5/7278 ,  A61B2562/04 ,  A61B2576/00

Abstract: What is disclosed is a video system and method that accounts for differences in imaging characteristics of differing video systems used to acquire video of respective regions of interest of a subject being monitored for a desired physiological function. In one embodiment, video is captured using N video imaging devices, where N≧2, of respective regions of interest of a subject being monitored for a desired physiological function (i.e., a respiratory or cardiac function). Each video imaging device is different but has complimentary imaging characteristics. A reliability factor f is determined for each of the devices in a manner more fully disclosed herein. A time-series signal is generated from each of the videos. Each time-series signal is weighted by each respective reliability factor and combined to obtain a composite signal. A physiological signal can be then extracted from the composite signal. The processed physiological signal corresponds to the desired physiological function.

Abstract translation: 公开的是一种视频系统和方法，其考虑了用于获取正在被监视的期望生理功能的被摄体的感兴趣区域的视频的不同视频系统的成像特征的差异。 在一个实施例中，使用N个视频成像装置捕获视频，其中N≥2个被监测的对象的各个感兴趣区域用于期望的生理功能（即，呼吸或心脏功能）。 每个视频成像设备是不同的，但具有互补的成像特征。 以这里更全面地公开的方式为每个设备确定可靠性因子f。 从每个视频产生时间序列信号。 每个时间序列信号由每个相应的可靠性因子加权并组合以获得复合信号。 然后可以从复合信号中提取生理信号。 经处理的生理信号对应于所需的生理功能。

公开(公告)号：US20140142435A1

公开(公告)日：2014-05-22

申请号：US13680838

申请日：2012-11-19

Applicant: XEROX CORPORATION

Inventor： Edgar A. BERNAL ,  Lalit Keshav MESTHA

IPC: A61B5/091 ,  A61B5/08 ,  A61B5/11 ,  A61B5/00 ,  A61B5/113

CPC classification number: A61B5/091 ,  A61B5/0077 ,  A61B5/08 ,  A61B5/0816 ,  A61B5/1127 ,  A61B5/113 ,  A61B5/1135

Abstract: What is disclosed is a system and method for processing a video acquired using a 2D monocular video camera system to assess respiratory function of a subject of interest. In various embodiments hereof, respiration-related video signals are obtained from a temporal sequence of 3D surface maps that have been reconstructed based on an amount of distortion detected in a pattern placed over the subject's thoracic region (chest area) during video acquisition relative to known spatial characteristics of an undistorted reference pattern. Volume data and frequency information are obtained from the processed video signals to estimate chest volume and respiration rate. Other respiratory function estimations of the subject in the video can also be derived. The obtained estimations are communicated to a medical professional for assessment. The teachings hereof find their uses in settings where it is desirable to assess patient respiratory function in a non-contact, remote sensing environment.

Abstract translation: 公开的是用于处理使用2D单眼摄像机系统获取的视频来评估感兴趣的对象的呼吸功能的系统和方法。 在本发明的各种实施例中，呼吸相关视频信号是根据在视频采集期间相对于已知的对象的胸部区域（胸部区域）放置的图案中检测到的失真量已被重建的3D表面贴图的时间序列获得的。 未失真的参考模式的空间特征。 从处理的视频信号中获得体数据和频率信息，以估计胸部体积和呼吸速率。 还可以推导出视频中对象的其他呼吸功能估计。 获得的估计被传达给医疗专业人员进行评估。 本文的教导在需要在非接触式遥感环境中评估患者呼吸功能的设置中找到其用途。

公开(公告)号：US20170169307A1

公开(公告)日：2017-06-15

申请号：US14969147

申请日：2015-12-15

Applicant: Xerox Corporation

Inventor： Prathosh A. PRASAD ,  Lalit Keshav MESTHA ,  Himanshu J. MADHU

IPC: G06K9/46 ,  A61B5/08 ,  A61B5/11 ,  G06K9/00 ,  A61B5/113 ,  A61B5/00 ,  G06K9/40

CPC classification number: G06K9/4647 ,  A61B5/0013 ,  A61B5/0077 ,  A61B5/08 ,  A61B5/1128 ,  A61B5/1135 ,  A61B2576/00 ,  G06K9/0053 ,  G06K9/00751 ,  G06K9/40 ,  G06K9/4661 ,  G06K2209/05 ,  G06T7/0012 ,  G06T7/20

Abstract: A video is received of a region of a subject where a signal corresponding to respiratory function can be registered by a video device. Pixels in the region in each of the image frames are processed to identify a respiratory pattern with peak/valley pairs. A peak/valley pair of interest is selected. An array of optical flow vectors is determined between a window of groups of pixel locations in a reference image frame corresponding to a peak of the pair/valley pair and a window in each of a number of image frames corresponding to the respiratory signal between the peak and ending at a valley point. Optical flow vectors have a direction and a magnitude. A ratio is determined between upwardly pointing optical flow vectors and downwardly pointing optical flow vectors. Based on the ratio, a determination is made whether the respiration phase for that peak/valley pair is inspiration or expiration.

公开(公告)号：US20160198965A1

公开(公告)日：2016-07-14

申请号：US14593271

申请日：2015-01-09

Applicant: Xerox Corporation

Inventor： Lalit Keshav MESTHA ,  Martin Edward HOOVER ,  Survi KYAL

IPC: A61B5/024 ,  A61B5/00

CPC classification number: A61B5/02433 ,  A61B5/0013 ,  A61B5/7203 ,  A61B5/7225 ,  A61B5/725 ,  A61B5/748 ,  A61B2576/00

Abstract: What is disclosed is a system and method for selecting a region of interest for extracting physiological parameters from a video of a subject. In one embodiment the present method involves performing the following. First, time-series signals are received which have been generated by having processing image frames of a video of a subject captured using a single band video camera with a bandpass filter with a pass band in a wavelength range of 495-565 nm and/or 800-1000 nm. The regions of interest are areas where a plethysmographic signal can be detected by the camera. Each time-series signal is associated with a different region of interest. A signal strength is then calculated for each of the time-series signals. The region associated with the time-series signal having a highest signal strength is selected. The time-series signal associated with the selected region can be processed to extract a videoplethysmographic (VPG) signal containing physiological parameters.

Abstract translation: 公开的是用于从对象的视频中提取生理参数来选择感兴趣区域的系统和方法。 在一个实施例中，本方法涉及执行以下操作。 首先，通过使用具有带通滤波器的单频带摄像机拍摄的被摄体的视频的处理图像帧在波长范围为495-565nm和/或 800-1000nm。 感兴趣的区域是可以通过照相机检测体积描记信号的区域。 每个时间序列信号与不同的感兴趣区域相关联。 然后为每个时间序列信号计算信号强度。 选择与具有最高信号强度的时间序列信号相关联的区域。 可以处理与所选区域相关联的时间序列信号以提取包含生理参数的视频体积描记（VPG）信号。

公开(公告)号：US20160135729A1

公开(公告)日：2016-05-19

申请号：US14548002

申请日：2014-11-19

Applicant: Xerox Corporation

Inventor： Lalit Keshav MESTHA ,  Krithika VENKATARAMANI

IPC: A61B5/00 ,  A61B5/01

CPC classification number: A61B5/4312 ,  A61B5/0013 ,  A61B5/0022 ,  A61B5/004 ,  A61B5/0077 ,  A61B5/015 ,  A61B5/7264 ,  A61B5/7267 ,  A61B5/746 ,  A61B5/748 ,  A61B10/0041 ,  A61B2560/0475 ,  A61B2576/02 ,  G06F19/00 ,  G16H30/40

Abstract: What is disclosed is a system and method for the detection of cancerous tissue by analyzing blocks of pixels in a thermal image of a region of exposed skin tissue. In one embodiment, matrices are received which have been derived from vectors of temperature values associated with pixels in blocks of pixels which have been isolated from a plurality of thermal images of both cancerous and non-cancerous tissue. The vectors are rearranged to form matrices. A thermal image of a subject is received. Blocks of pixels which reside within a region of exposed skin tissue are identified and isolated. For each identified pixel block, an image vector comprising temperature values associated with these pixels is formed. The vector is provided to a classifier which uses the matrices to classify tissue associated with this block of pixels as being either cancerous or non-cancerous tissue.

Abstract translation: 公开的是通过分析暴露的皮肤组织的区域的热图像中的像素块来检测癌组织的系统和方法。 在一个实施例中，接收已经从与癌和非癌组织的多个热图像分离的像素块中的像素相关联的温度值的矢量导出的矩阵。 重新排列向量以形成矩阵。 收到受试者的热图像。 识别和分离驻留在暴露的皮肤组织的区域内的像素块。 对于每个识别的像素块，形成包括与这些像素相关联的温度值的图像矢量。 该向量被提供给分类器，其使用矩阵来将与该像素块相关联的组织分类为癌性或非癌性组织。