公开(公告)号：US09325947B2

公开(公告)日：2016-04-26

申请号：US13664289

申请日：2012-10-30

Applicant: InView Technology Corporation

Inventor： Robert F. Bridge ,  Lenore McMackin

IPC: H04N7/18 ,  H04N5/232

CPC classification number: H04N7/18 ,  H04N5/232 ,  H04N5/335

Abstract: A compressive imaging system and method for quickly detecting spectrally and spatially localized events (such as explosions or gun discharges) occurring within the field of view. An incident light stream is modulated with a temporal sequence of spatial patterns. The wavelength components in the modulated light stream are spatially separated, e.g., using a diffractive element. An array of photodetectors is used to convert subsets of the wavelength components into respective signals. An image representing the field of view may be reconstructed based on samples from some or all the signals. A selected subset of the signals are monitored to detect event occurrences, e.g., by detecting sudden changes in intensity. When the event is detected, sample data from the selected subset of signals may be analyzed to determine the event location within the field of view. The event location may be highlighted in an image being generated by the imaging system.

Abstract translation: 一种压缩成像系统和方法，用于快速检测在视场内发生的光谱和空间局部化事件（例如爆炸或喷枪排放）。 入射光流以空间模式的时间序列调制。 调制光流中的波长分量在空间上分离，例如使用衍射元件。 一组光电检测器用于将波长分量的子集转换为相应的信号。 可以基于来自一些或所有信号的样本来重构表示视场的图像。 监视所选信号的子集以检测事件发生，例如通过检测强度的突然变化。 当检测到事件时，可以分析来自所选择的信号子集的采样数据，以确定视场内的事件位置。 可以在由成像系统生成的图像中突出显示事件位置。

公开(公告)号：US09460052B2

公开(公告)日：2016-10-04

申请号：US14137206

申请日：2013-12-20

Applicant: InView Technology Corporation

Inventor： Thomas A. Goldstein ,  Matthew A. Herman

IPC: G06F17/10 ,  G06T9/00 ,  H04N19/90

CPC classification number: G06F17/10 ,  G06T9/00 ,  H04N19/90

Abstract: A mechanism for reconstructing a signal (e.g., an image) based on a vector s, which includes measurements of the signal. The measurements have been acquired using at least a portion of a measurement vector set represented by a matrix H. Each of the measurements corresponds to a respective row of the matrix H. (For example, each of the measurements may correspond to an inner product between the signal and a respective row of the matrix product HD, wherein D is a generalized permutation matrix.) A total-variation primal-dual hybrid gradient (TV-PDHG) algorithm is executed based on data including the matrix H and the vector s, to determine an estimate for the signal. The TV-PDHG algorithm is implemented in fixed-point arithmetic.

Abstract translation: 一种用于基于矢量s重建信号（例如，图像）的机制，其包括信号的测量。 使用由矩阵H表示的测量向量集的至少一部分已经获得了测量。每个测量对应于矩阵H的相应行。（例如，每个测量可以对应于 信号和矩阵乘积HD的相应行，其中D是广义置换矩阵。）基于包括矩阵H和向量s的数据执行总变异原始双双混合梯度（TV-PDHG）算法， 以确定信号的估计。 TV-PDHG算法以定点算法实现。

公开(公告)号：US09081731B2

公开(公告)日：2015-07-14

申请号：US14169903

申请日：2014-01-31

Applicant: InView Technology Corporation

Inventor： Matthew A. Herman ,  Tyler H. Weston

IPC: H04N19/112 ,  G06F17/14 ,  G06T9/00 ,  G06T1/00 ,  H04N5/232

CPC classification number: G06F17/145 ,  G06T1/0007 ,  G06T9/00 ,  H04N5/23229 ,  H04N19/90

Abstract: If a Hadamard matrix HN of order N=BF is a Kronecker product HFHB of an order F Hadamard matrix and an order B Hadamard matrix, then transformation by HN may be implemented by a fast Hadamard transform at coarse scale followed by fast Hadamard transforms at fine scale. Alternatively, transformation by HN may be achieved by performing order B transforms on columns of a two-dimensional array and order B transforms on rows of the array. As another alternative, transformation by HN may be achieved by computing intermediate values based on linear combinations of input elements and then computing linear combinations of the intermediate values. For compressive signal acquisition, any row of HN may be generated by concatenating selectively modified copies of a corresponding row of HB. Thus, modulation patterns may be generated on the fly.

Abstract translation: 如果阶N = BF的Hadamard矩阵HN是F阶Hadamard矩阵的Kronecker积HFHB和B阶Hadamard矩阵，则HN的变换可以通过在粗尺度上的快速Hadamard变换来实现，随后是快速Hadamard变换 规模。 或者，可以通过对二维阵列的列执行B阶变换并且对阵列的行上的阶数B进行变换来实现HN的变换。 作为另一替代方案，可以通过基于输入元素的线性组合计算中间值，然后计算中间值的线性组合来实现HN的变换。 对于压缩信号采集，可以通过连接HB的相应行的选择性修改的副本来生成任何HN行。 因此，可以在飞行中产生调制模式。

公开(公告)号：US08970740B2

公开(公告)日：2015-03-03

申请号：US14106542

申请日：2013-12-13

Applicant: InView Technology Corporation

Inventor： Matthew A. Herman ,  Donna E. Hewitt ,  Tyler H. Weston ,  Lenore McMackin

IPC: H04N5/217 ,  G06T5/00 ,  G06T5/50

CPC classification number: G06T5/001 ,  G06T5/50 ,  G06T2207/10052 ,  G06T2207/20212

Abstract: A mechanism for reconstructing sub-images based on measurement data acquired by an imaging system including an array of light modulating elements and an array of photodetectors. Each sub-image is reconstructed based on samples from a respective photodetector and a respective set of measurement patterns defined on a respective virtual sub-region on the modulating array. Each virtual sub-region is configured to include at least the light modulating elements that are able to send a non-trivial amount of light to the respective photodetector during a pattern application period. The virtual sub-regions overlap because many light modulating elements are capable of sending light to more than one photodetector. Whenever a measurement pattern of one virtual sub-region overlaps the measurement pattern of a neighboring virtual sub-region, the two measurement patterns agree by design. Thus, the measurement patterns for the collection of virtual sub-regions combine to form a pattern on the whole modulating array.

Abstract translation: 一种用于基于由包括光调制元件阵列和光电检测器阵列的成像系统获取的测量数据重建子图像的机构。 基于来自相应光电检测器的样本和在调制阵列上的相应虚拟子区域上定义的相应的一组测量图案重建每个子图像。 每个虚拟子区域被配置为至少包括能够在图案应用周期期间向相应光电检测器发送不平凡量的光的光调制元件。 虚拟子区域重叠，因为许多光调制元件能够向多于一个的光电检测器发送光。 每当一个虚拟子区域的测量图案与相邻虚拟子区域的测量图案重叠时，两个测量图案被设计一致。 因此，用于收集虚拟子区域的测量模式组合在整个调制阵列上形成图案。

公开(公告)号：US20140297703A1

公开(公告)日：2014-10-02

申请号：US14137206

申请日：2013-12-20

Applicant: InView Technology Corporation

Inventor： Thomas A. Goldstein ,  Matthew A. Herman

IPC: G06F17/16

CPC classification number: G06F17/10 ,  G06T9/00 ,  H04N19/90

Abstract: A mechanism for reconstructing a signal (e.g., an image) based on a vector s, which includes measurements of the signal. The measurements have been acquired using at least a portion of a measurement vector set represented by a matrix H. Each of the measurements corresponds to a respective row of the matrix H. (For example, each of the measurements may correspond to an inner product between the signal and a respective row of the matrix product HD, wherein D is a generalized permutation matrix.) A total-variation primal-dual hybrid gradient (TV-PDHG) algorithm is executed based on data including the matrix H and the vector s, to determine an estimate for the signal. The TV-PDHG algorithm is implemented in fixed-point arithmetic.

Abstract translation: 一种用于基于矢量s重建信号（例如，图像）的机制，其包括信号的测量。 使用由矩阵H表示的测量向量集的至少一部分已经获得了测量。每个测量对应于矩阵H的相应行。（例如，每个测量可以对应于 信号和矩阵乘积HD的相应行，其中D是广义置换矩阵。）基于包括矩阵H和向量s的数据执行总变异原始双双混合梯度（TV-PDHG）算法， 以确定信号的估计。 TV-PDHG算法以定点算法实现。

公开(公告)号：US20140198236A1

公开(公告)日：2014-07-17

申请号：US14154817

申请日：2014-01-14

Applicant: InView Technology Corporation

Inventor： Matthew A. Herman

IPC: H04N5/265

CPC classification number: H04N5/265 ,  G06K2009/4695 ,  H03M7/3062 ,  H04N5/335

Abstract: A methodology for acquiring measurements of a signal at one or more scales of resolution, including: generating modulation patterns based on a predefined measurement matrix; modulating a received signal with the modulation patterns using the signal modulating array to obtain a modulated signal; and acquiring measurements of intensity of the modulated signal. Each modulation pattern is generated by: (a) selecting a corresponding row of the measurement matrix; (b) reordering elements of the selected row according to a permutation to obtain a reordered row; and (c) transferring the reordered row to the signal modulating array so that elements of the reordered row are mapped onto the signal modulating array. The permutation is defined so that a subset of the modulation patterns are coarse patterns that respect a partition of the signal modulating array into an array of superpixels, each superpixel including a respective group of the signal modulating elements.

Abstract translation: 一种用于以一个或多个分辨率尺度获取信号的测量的方法，包括：基于预定义的测量矩阵产生调制模式; 使用所述信号调制阵列调制具有所述调制图案的接收信号以获得调制信号; 并获取调制信号强度的测量值。 每个调制模式通过以下方式产生：（a）选择测量矩阵的相应行; （b）根据排列对所选择的行的元素重新排序以获得重新排序的行; 和（c）将重新排序的行传送到信号调制阵列，使得重新排序的行的元素被映射到信号调制阵列上。 定义排列，使得调制图案的子集是将信号调制阵列的分区相对于超像素阵列的粗略图案，每个超像素包括相应的信号调制元件组。

公开(公告)号：US08760542B2

公开(公告)日：2014-06-24

申请号：US14135154

申请日：2013-12-19

Applicant: InView Technology Corporation

Inventor： Robert F. Bridge ,  Matthew A. Herman ,  Donna E. Hewitt ,  Tyler H. Weston ,  Justin A. Fritz

IPC: H04N5/217 ,  H04N9/73 ,  G03B13/00 ,  H04N5/235 ,  H04N5/243 ,  G02B26/08

CPC classification number: H04N5/2351 ,  G02B26/0833 ,  H04N5/2354 ,  H04N5/243 ,  H04N5/335

Abstract: An imaging system and method that captures compressive sensing (CS) measurements of a received light stream, and also obtains samples of background light level (BGLL). The BGLL samples may be used to compensate the CS measurements for variations in the BGLL. The system includes: a light modulator to spatially modulate the received light stream with spatial patterns, and a lens to concentrate the modulated light stream onto a light detector. The samples of BGLL may be obtained in various ways: (a) injecting calibration patterns among the spatial patterns; (b) measuring complementary light reflected by digital micromirrors onto a secondary output path; (c) separating and measuring a portion of light from the optical input path; (d) low-pass filtering the CS measurements; and (e) employing a light power meter with its own separate input path. Also, the CS measurements may be high-pass filtered to attenuate background light variation.

Abstract translation: 捕获接收的光流的压缩感测（CS）测量的成像系统和方法，并且还获得背景光级（BGLL）的样本。 BGLL样本可用于补偿BGLL中的变化的CS测量。 该系统包括：用空间模式对接收到的光流进行空间调制的光调制器，以及将调制光流集中到光检测器上的透镜。 BGLL的样本可以以各种方式获得：（a）在空间图案之间注入校准图案; （b）测量由数字微镜反射到辅助输出路径上的互补光; （c）分离和测量来自光学输入路径的一部分光; （d）CS测量的低通滤波; 和（e）使用具有其自己的独立输入路径的光功率计。 此外，CS测量可以被高通滤波以衰减背景光的变化。

公开(公告)号：US08717466B2

公开(公告)日：2014-05-06

申请号：US14017834

申请日：2013-09-04

Applicant: InView Technology Corporation

Inventor： Richard G. Baraniuk ,  Kevin F. Kelly ,  Robert F. Bridge ,  Sujoy Chatterjee ,  Lenore McMackin

IPC: H04N9/097 ,  H04N5/225

CPC classification number: H04N5/238 ,  G02B26/0833 ,  H04N5/2351 ,  H04N5/2354 ,  H04N5/335

Abstract: An imaging system and method that captures compressive sensing (CS) measurements of a received light stream, and also obtains samples of background light level (BGLL). The BGLL samples may be used to compensate the CS measurements for variations in the BGLL. The system includes: a light modulator to spatially modulate the received light stream with spatial patterns, and a lens to concentrate the modulated light stream onto a light detector. The samples of BGLL may be obtained in various ways: (a) injecting calibration patterns among the spatial patterns; (b) measuring complementary light reflected by digital micromirrors onto a secondary output path; (c) separating and measuring a portion of light from the optical input path; (d) low-pass filtering the CS measurements; and (e) employing a light power meter with its own separate input path. Also, the CS measurements may be high-pass filtered to attenuate background light variation.

Abstract translation: 捕获接收的光流的压缩感测（CS）测量的成像系统和方法，并且还获得背景光级（BGLL）的样本。 BGLL样本可用于补偿BGLL中的变化的CS测量。 该系统包括：用空间模式对接收到的光流进行空间调制的光调制器，以及将调制光流集中到光检测器上的透镜。 BGLL的样本可以以各种方式获得：（a）在空间图案之间注入校准图案; （b）测量由数字微镜反射到辅助输出路径上的互补光; （c）分离和测量来自光学输入路径的一部分光; （d）CS测量的低通滤波; 和（e）使用具有其自己的独立输入路径的光功率计。 此外，CS测量可以被高通滤波以衰减背景光的变化。

公开(公告)号：US20140009638A1

公开(公告)日：2014-01-09

申请号：US14017834

申请日：2013-09-04

Applicant: InView Technology Corporation

Inventor： Richard G. Baraniuk ,  Kevin F. Kelly ,  Robert F. Bridge ,  Sujoy Chatterjee ,  Lenore McMackin

IPC: H04N5/238

CPC classification number: H04N5/238 ,  G02B26/0833 ,  H04N5/2351 ,  H04N5/2354 ,  H04N5/335

Abstract: An imaging system and method that captures compressive sensing (CS) measurements of a received light stream, and also obtains samples of background light level (BGLL). The BGLL samples may be used to compensate the CS measurements for variations in the BGLL. The system includes: a light modulator to spatially modulate the received light stream with spatial patterns, and a lens to concentrate the modulated light stream onto a light detector. The samples of BGLL may be obtained in various ways: (a) injecting calibration patterns among the spatial patterns; (b) measuring complementary light reflected by digital micromirrors onto a secondary output path; (c) separating and measuring a portion of light from the optical input path; (d) low-pass filtering the CS measurements; and (e) employing a light power meter with its own separate input path. Also, the CS measurements may be high-pass filtered to attenuate background light variation.

Abstract translation: 捕获接收的光流的压缩感测（CS）测量的成像系统和方法，并且还获得背景光级（BGLL）的样本。 BGLL样本可用于补偿BGLL中的变化的CS测量。 该系统包括：用空间模式对接收到的光流进行空间调制的光调制器，以及将调制光流集中到光检测器上的透镜。 BGLL的样本可以以各种方式获得：（a）在空间图案之间注入校准图案; （b）测量由数字微镜反射到辅助输出路径上的互补光; （c）分离和测量来自光学输入路径的一部分光; （d）CS测量的低通滤波; 和（e）使用具有其自己的独立输入路径的光功率计。 此外，CS测量可以被高通滤波以衰减背景光的变化。

公开(公告)号：US20140002721A1

公开(公告)日：2014-01-02

申请号：US14017581

申请日：2013-09-04

Applicant: InView Technology Corporation

Inventor： Richard G. Baraniuk ,  Kevin F. Kelly ,  Robert F. Bridge ,  Sujoy Chatterjee ,  Lenore McMackin

IPC: H04N5/235

CPC classification number: H04N5/238 ,  G02B26/0833 ,  H04N5/2351 ,  H04N5/2354 ,  H04N5/335

Abstract: An imaging system and method that captures compressive sensing (CS) measurements of a received light stream, and also obtains samples of background light level (BGLL). The BGLL samples may be used to compensate the CS measurements for variations in the BGLL. The system includes: a light modulator to spatially modulate the received light stream with spatial patterns, and a lens to concentrate the modulated light stream onto a light detector. The samples of BGLL may be obtained in various ways: (a) injecting calibration patterns among the spatial patterns; (b) measuring complementary light reflected by digital micromirrors onto a secondary output path; (c) separating and measuring a portion of light from the optical input path; (d) low-pass filtering the CS measurements; and (e) employing a light power meter with its own separate input path. Also, the CS measurements may be high-pass filtered to attenuate background light variation.

Abstract translation: 捕获接收的光流的压缩感测（CS）测量的成像系统和方法，并且还获得背景光级（BGLL）的样本。 BGLL样本可用于补偿BGLL中的变化的CS测量。 该系统包括：用空间模式对接收到的光流进行空间调制的光调制器，以及将调制光流集中到光检测器上的透镜。 BGLL的样本可以以各种方式获得：（a）在空间图案之间注入校准图案; （b）测量由数字微镜反射到辅助输出路径上的互补光; （c）分离和测量来自光学输入路径的一部分光; （d）CS测量的低通滤波; 和（e）使用具有其自己的独立输入路径的光功率计。 此外，CS测量可以被高通滤波以衰减背景光的变化。