公开(公告)号：US09325947B2

公开(公告)日：2016-04-26

申请号：US13664289

申请日：2012-10-30

Applicant: InView Technology Corporation

Inventor： Robert F. Bridge ,  Lenore McMackin

IPC: H04N7/18 ,  H04N5/232

CPC classification number: H04N7/18 ,  H04N5/232 ,  H04N5/335

Abstract: A compressive imaging system and method for quickly detecting spectrally and spatially localized events (such as explosions or gun discharges) occurring within the field of view. An incident light stream is modulated with a temporal sequence of spatial patterns. The wavelength components in the modulated light stream are spatially separated, e.g., using a diffractive element. An array of photodetectors is used to convert subsets of the wavelength components into respective signals. An image representing the field of view may be reconstructed based on samples from some or all the signals. A selected subset of the signals are monitored to detect event occurrences, e.g., by detecting sudden changes in intensity. When the event is detected, sample data from the selected subset of signals may be analyzed to determine the event location within the field of view. The event location may be highlighted in an image being generated by the imaging system.

Abstract translation: 一种压缩成像系统和方法，用于快速检测在视场内发生的光谱和空间局部化事件（例如爆炸或喷枪排放）。 入射光流以空间模式的时间序列调制。 调制光流中的波长分量在空间上分离，例如使用衍射元件。 一组光电检测器用于将波长分量的子集转换为相应的信号。 可以基于来自一些或所有信号的样本来重构表示视场的图像。 监视所选信号的子集以检测事件发生，例如通过检测强度的突然变化。 当检测到事件时，可以分析来自所选择的信号子集的采样数据，以确定视场内的事件位置。 可以在由成像系统生成的图像中突出显示事件位置。

公开(公告)号：US09160914B2

公开(公告)日：2015-10-13

申请号：US13534249

申请日：2012-06-27

Applicant: Robert F. Bridge ,  Donna E. Hewitt ,  Tyler H. Weston

Inventor： Robert F. Bridge ,  Donna E. Hewitt ,  Tyler H. Weston

IPC: H04N5/64 ,  H04L27/00 ,  H04N5/232 ,  H04N19/97

CPC classification number: H04N5/232 ,  G06F19/00 ,  H04N19/97

Abstract: A compressive imaging system modulates an incident light stream and senses the modulated light stream to obtain compressive measurements. The measurements are algorithmically processed to reconstruct a sequence of images. The image sequence is displayed. The system receives user input (through a user interface) representing a user command to set or change one or more visual performance factors such as image quality and frame rate. The system immediately adjusts the visual performance factors by adjusting one or more underlying system parameters/algorithms. Thus, the visual consequences of any inputs to the user interface become immediately apparent in the displayed sequence of images. The user may therefore intuitively learn how to operate the user interface simply by making trial inputs and observing their effects in the displayed image sequence. The user interface may include one or more mechanical input devices and/or one or more graphical user interface (GUI) elements.

Abstract translation: 压缩成像系统调制入射光流并感测调制的光流以获得压缩测量。 对算法进行算法处理以重构图像序列。 显示图像序列。 系统接收表示用户命令的用户输入（通过用户界面）来设置或改变一个或多个视觉性能因素，例如图像质量和帧速率。 系统通过调整一个或多个底层系统参数/算法立即调整视觉性能因素。 因此，在所显示的图像序列中，对用户界面的任何输入的视觉后果变得立即显现。 因此，用户可以直观地学习如何通过进行试用输入并观察其在所显示的图像序列中的效果来操作用户界面。 用户界面可以包括一个或多个机械输入设备和/或一个或多个图形用户界面（GUI）元件。

公开(公告)号：US08717463B2

公开(公告)日：2014-05-06

申请号：US13207258

申请日：2011-08-10

Applicant: Gary L. Woods ,  James M. Tidman

Inventor： Gary L. Woods ,  James M. Tidman

IPC: H04N5/217 ,  G06K9/00

CPC classification number: H04N5/335

Abstract: A compressive imaging (CI) device for attenuating noise. The CI device may acquire samples during steady state portions of pattern modulation periods, avoiding the disturbing effect of transients that occur at pattern transitions. A CI device may acquire and then average multiple samples per spatial pattern to reduce (deterministic and/or random) zero-mean noise. A CI device may apply a filter to the photodetector signal in the analog domain and/or in the digital domain to attenuate noise components, e.g., noise due to electromagnetic interference.

Abstract translation: 用于衰减噪声的压缩成像（CI）装置。 CI器件可以在模式调制周期的稳态部分期间采集采样，避免在模式转换期间发生的瞬变的干扰效应。 CI设备可以获取并且然后平均每个空间模式的多个样本以减少（确定性和/或随机）零均值噪声。 CI器件可以对模拟域和/或数字域中的光电检测器信号应用滤波器以衰减噪声分量，例如由于电磁干扰引起的噪声。

公开(公告)号：US09460052B2

公开(公告)日：2016-10-04

申请号：US14137206

申请日：2013-12-20

Applicant: InView Technology Corporation

Inventor： Thomas A. Goldstein ,  Matthew A. Herman

IPC: G06F17/10 ,  G06T9/00 ,  H04N19/90

CPC classification number: G06F17/10 ,  G06T9/00 ,  H04N19/90

Abstract: A mechanism for reconstructing a signal (e.g., an image) based on a vector s, which includes measurements of the signal. The measurements have been acquired using at least a portion of a measurement vector set represented by a matrix H. Each of the measurements corresponds to a respective row of the matrix H. (For example, each of the measurements may correspond to an inner product between the signal and a respective row of the matrix product HD, wherein D is a generalized permutation matrix.) A total-variation primal-dual hybrid gradient (TV-PDHG) algorithm is executed based on data including the matrix H and the vector s, to determine an estimate for the signal. The TV-PDHG algorithm is implemented in fixed-point arithmetic.

Abstract translation: 一种用于基于矢量s重建信号（例如，图像）的机制，其包括信号的测量。 使用由矩阵H表示的测量向量集的至少一部分已经获得了测量。每个测量对应于矩阵H的相应行。（例如，每个测量可以对应于 信号和矩阵乘积HD的相应行，其中D是广义置换矩阵。）基于包括矩阵H和向量s的数据执行总变异原始双双混合梯度（TV-PDHG）算法， 以确定信号的估计。 TV-PDHG算法以定点算法实现。

公开(公告)号：US09081731B2

公开(公告)日：2015-07-14

申请号：US14169903

申请日：2014-01-31

Applicant: InView Technology Corporation

Inventor： Matthew A. Herman ,  Tyler H. Weston

IPC: H04N19/112 ,  G06F17/14 ,  G06T9/00 ,  G06T1/00 ,  H04N5/232

CPC classification number: G06F17/145 ,  G06T1/0007 ,  G06T9/00 ,  H04N5/23229 ,  H04N19/90

Abstract: If a Hadamard matrix HN of order N=BF is a Kronecker product HFHB of an order F Hadamard matrix and an order B Hadamard matrix, then transformation by HN may be implemented by a fast Hadamard transform at coarse scale followed by fast Hadamard transforms at fine scale. Alternatively, transformation by HN may be achieved by performing order B transforms on columns of a two-dimensional array and order B transforms on rows of the array. As another alternative, transformation by HN may be achieved by computing intermediate values based on linear combinations of input elements and then computing linear combinations of the intermediate values. For compressive signal acquisition, any row of HN may be generated by concatenating selectively modified copies of a corresponding row of HB. Thus, modulation patterns may be generated on the fly.

Abstract translation: 如果阶N = BF的Hadamard矩阵HN是F阶Hadamard矩阵的Kronecker积HFHB和B阶Hadamard矩阵，则HN的变换可以通过在粗尺度上的快速Hadamard变换来实现，随后是快速Hadamard变换 规模。 或者，可以通过对二维阵列的列执行B阶变换并且对阵列的行上的阶数B进行变换来实现HN的变换。 作为另一替代方案，可以通过基于输入元素的线性组合计算中间值，然后计算中间值的线性组合来实现HN的变换。 对于压缩信号采集，可以通过连接HB的相应行的选择性修改的副本来生成任何HN行。 因此，可以在飞行中产生调制模式。

公开(公告)号：US20140297703A1

公开(公告)日：2014-10-02

申请号：US14137206

申请日：2013-12-20

Applicant: InView Technology Corporation

Inventor： Thomas A. Goldstein ,  Matthew A. Herman

IPC: G06F17/16

CPC classification number: G06F17/10 ,  G06T9/00 ,  H04N19/90

Abstract: A mechanism for reconstructing a signal (e.g., an image) based on a vector s, which includes measurements of the signal. The measurements have been acquired using at least a portion of a measurement vector set represented by a matrix H. Each of the measurements corresponds to a respective row of the matrix H. (For example, each of the measurements may correspond to an inner product between the signal and a respective row of the matrix product HD, wherein D is a generalized permutation matrix.) A total-variation primal-dual hybrid gradient (TV-PDHG) algorithm is executed based on data including the matrix H and the vector s, to determine an estimate for the signal. The TV-PDHG algorithm is implemented in fixed-point arithmetic.

Abstract translation: 一种用于基于矢量s重建信号（例如，图像）的机制，其包括信号的测量。 使用由矩阵H表示的测量向量集的至少一部分已经获得了测量。每个测量对应于矩阵H的相应行。（例如，每个测量可以对应于 信号和矩阵乘积HD的相应行，其中D是广义置换矩阵。）基于包括矩阵H和向量s的数据执行总变异原始双双混合梯度（TV-PDHG）算法， 以确定信号的估计。 TV-PDHG算法以定点算法实现。

公开(公告)号：US08634009B2

公开(公告)日：2014-01-21

申请号：US13207276

申请日：2011-08-10

Applicant: Kevin F. Kelly ,  Gary L. Woods ,  Lenore McMackin ,  Robert F. Bridge ,  James M. Tidman ,  Donna E. Hewitt

Inventor： Kevin F. Kelly ,  Gary L. Woods ,  Lenore McMackin ,  Robert F. Bridge ,  James M. Tidman ,  Donna E. Hewitt

IPC: H04N3/14 ,  H04N5/335 ,  H04N5/225

CPC classification number: H04N5/238 ,  G02B26/0833 ,  H04N5/2351 ,  H04N5/2354 ,  H04N5/335

Abstract: A compressive imaging system for optimizing dynamic range during the acquisition of compressed images. A light modulator modulates incident light with spatial patterns to produced modulated light. A light sensing device generates an electrical signal representing intensity of the modulated light over time. The system amplifies a difference between the electrical signal and an adjustable baseline voltage and captures samples of the amplified signal. The adjustable baseline voltage is set to be approximately equal to the average value of the electrical signal. A compressive imaging system for identifying and correcting hot spot(s) in the incident light field. Search patterns are sent to the light modulator and the corresponding samples of the electrical signal are analyzed. Once the hot spot is located, the light modulating elements corresponding to the hot spot may be turned off or their duty cycle may be reduced.

Abstract translation: 压缩成像系统，用于在获取压缩图像期间优化动态范围。 光调制器利用空间图案调制入射光以产生调制光。 光感测装置产生表示随时间变化的调制光强度的电信号。 系统放大电信号和可调基线电压之间的差异，并捕获放大信号的采样。 可调基线电压被设置为近似等于电信号的平均值。 用于识别和校正入射光场中的热点的压缩成像系统。 搜索模式被发送到光调制器，并且分析相应的电信号样本。 一旦设置了热点，则可以关闭对应于热点的光调制元件，或者可以减少占空比。

公开(公告)号：US08570406B2

公开(公告)日：2013-10-29

申请号：US13193556

申请日：2011-07-28

Applicant: Kevin F. Kelly ,  Richard G. Baraniuk ,  Lenore McMackin ,  Robert F. Bridge ,  Sujoy Chatterjee ,  Donna E. Hewitt ,  Tyler H. Weston

Inventor： Kevin F. Kelly ,  Richard G. Baraniuk ,  Lenore McMackin ,  Robert F. Bridge ,  Sujoy Chatterjee ,  Donna E. Hewitt ,  Tyler H. Weston

IPC: H04N5/217 ,  H04N5/228 ,  H04N7/12 ,  H03M1/00 ,  G06K9/40

CPC classification number: H04N5/238 ,  G02B26/0833 ,  H04N5/2351 ,  H04N5/2354 ,  H04N5/335

Abstract: An imaging system and method that captures compressive sensing (CS) measurements of a received light stream, and also obtains samples of background light level (BGLL). The BGLL samples may be used to compensate the CS measurements for variations in the BGLL. The system includes: a light modulator to spatially modulate the received light stream with spatial patterns, and a lens to concentrate the modulated light stream onto a light detector. The samples of BGLL may be obtained in various ways: (a) injecting calibration patterns among the spatial patterns; (b) measuring complementary light reflected by digital micromirrors onto a secondary output path; (c) separating and measuring a portion of light from the optical input path; (d) low-pass filtering the CS measurements; and (e) employing a light power meter with its own separate input path. Also, the CS measurements may be high-pass filtered to attenuate background light variation.

Abstract translation: 捕获接收的光流的压缩感测（CS）测量的成像系统和方法，并且还获得背景光级（BGLL）的样本。 BGLL样本可用于补偿BGLL中的变化的CS测量。 该系统包括：用空间模式对接收到的光流进行空间调制的光调制器，以及将调制光流集中到光检测器上的透镜。 BGLL的样本可以以各种方式获得：（a）在空间图案之间注入校准图案; （b）测量由数字微镜反射到辅助输出路径上的互补光; （c）分离和测量来自光学输入路径的一部分光; （d）CS测量的低通滤波; 和（e）使用具有其自己的独立输入路径的光功率计。 此外，CS测量可以被高通滤波以衰减背景光的变化。

公开(公告)号：US08860835B2

公开(公告)日：2014-10-14

申请号：US13197304

申请日：2011-08-03

Applicant: Kevin F. Kelly ,  Richard G. Baraniuk ,  Lenore McMackin ,  Robert F. Bridge ,  Sujoy Chatterjee ,  Tyler H. Weston

Inventor： Kevin F. Kelly ,  Richard G. Baraniuk ,  Lenore McMackin ,  Robert F. Bridge ,  Sujoy Chatterjee ,  Tyler H. Weston

IPC: H04N5/228 ,  G02B26/08 ,  H04N5/335 ,  H04N5/341

CPC classification number: G02B26/0833 ,  H04N5/335 ,  H04N5/3415

Abstract: Mechanisms for increasing the rate of acquisition of compressed/encoded image representations are disclosed. An imaging system may deliver subsets of a modulated light stream onto respective light sensing devices. The light sensing devices may be sampled in parallel. Samples from each light sensing device may be used to construct a respective sub-image of a final image. The parallelism allows compressed images to be acquired at a higher rate. The number of light sensing devices and/or the number of pixels per image may be selected to achieve a target image acquisition rate. In another embodiment, spatial portions of the incident light stream are separated and delivered to separate light modulators. In yet another embodiment, the incident light stream is split into a plurality of beams, each of which retains the image present in the incident light stream and is delivered to a separate light modulator.

Abstract translation: 公开了用于增加压缩/编码图像表示的获取速率的机制。 成像系统可以将调制的光流的子集传送到相应的光感测装置上。 光感测装置可以并行采样。 来自每个光感测装置的样品可用于构建最终图像的相应子图像。 并行性允许以更高的速率获取压缩图像。 可以选择光感测装置的数量和/或每个图像的像素数量以实现目标图像获取速率。 在另一个实施例中，入射光流的空间部分被分离并传送到单独的光调制器。 在另一个实施例中，入射光流被分成多个光束，每个光束保持存在于入射光流中的图像，并被传送到单独的光调制器。

公开(公告)号：US20140198236A1

公开(公告)日：2014-07-17

申请号：US14154817

申请日：2014-01-14

Applicant: InView Technology Corporation

Inventor： Matthew A. Herman

IPC: H04N5/265

CPC classification number: H04N5/265 ,  G06K2009/4695 ,  H03M7/3062 ,  H04N5/335

Abstract: A methodology for acquiring measurements of a signal at one or more scales of resolution, including: generating modulation patterns based on a predefined measurement matrix; modulating a received signal with the modulation patterns using the signal modulating array to obtain a modulated signal; and acquiring measurements of intensity of the modulated signal. Each modulation pattern is generated by: (a) selecting a corresponding row of the measurement matrix; (b) reordering elements of the selected row according to a permutation to obtain a reordered row; and (c) transferring the reordered row to the signal modulating array so that elements of the reordered row are mapped onto the signal modulating array. The permutation is defined so that a subset of the modulation patterns are coarse patterns that respect a partition of the signal modulating array into an array of superpixels, each superpixel including a respective group of the signal modulating elements.

Abstract translation: 一种用于以一个或多个分辨率尺度获取信号的测量的方法，包括：基于预定义的测量矩阵产生调制模式; 使用所述信号调制阵列调制具有所述调制图案的接收信号以获得调制信号; 并获取调制信号强度的测量值。 每个调制模式通过以下方式产生：（a）选择测量矩阵的相应行; （b）根据排列对所选择的行的元素重新排序以获得重新排序的行; 和（c）将重新排序的行传送到信号调制阵列，使得重新排序的行的元素被映射到信号调制阵列上。 定义排列，使得调制图案的子集是将信号调制阵列的分区相对于超像素阵列的粗略图案，每个超像素包括相应的信号调制元件组。