公开(公告)号：US20140198236A1

公开(公告)日：2014-07-17

申请号：US14154817

申请日：2014-01-14

Applicant: InView Technology Corporation

Inventor： Matthew A. Herman

IPC: H04N5/265

CPC classification number: H04N5/265 ,  G06K2009/4695 ,  H03M7/3062 ,  H04N5/335

Abstract: A methodology for acquiring measurements of a signal at one or more scales of resolution, including: generating modulation patterns based on a predefined measurement matrix; modulating a received signal with the modulation patterns using the signal modulating array to obtain a modulated signal; and acquiring measurements of intensity of the modulated signal. Each modulation pattern is generated by: (a) selecting a corresponding row of the measurement matrix; (b) reordering elements of the selected row according to a permutation to obtain a reordered row; and (c) transferring the reordered row to the signal modulating array so that elements of the reordered row are mapped onto the signal modulating array. The permutation is defined so that a subset of the modulation patterns are coarse patterns that respect a partition of the signal modulating array into an array of superpixels, each superpixel including a respective group of the signal modulating elements.

Abstract translation: 一种用于以一个或多个分辨率尺度获取信号的测量的方法，包括：基于预定义的测量矩阵产生调制模式; 使用所述信号调制阵列调制具有所述调制图案的接收信号以获得调制信号; 并获取调制信号强度的测量值。 每个调制模式通过以下方式产生：（a）选择测量矩阵的相应行; （b）根据排列对所选择的行的元素重新排序以获得重新排序的行; 和（c）将重新排序的行传送到信号调制阵列，使得重新排序的行的元素被映射到信号调制阵列上。 定义排列，使得调制图案的子集是将信号调制阵列的分区相对于超像素阵列的粗略图案，每个超像素包括相应的信号调制元件组。

公开(公告)号：US08760542B2

公开(公告)日：2014-06-24

申请号：US14135154

申请日：2013-12-19

Applicant: InView Technology Corporation

Inventor： Robert F. Bridge ,  Matthew A. Herman ,  Donna E. Hewitt ,  Tyler H. Weston ,  Justin A. Fritz

IPC: H04N5/217 ,  H04N9/73 ,  G03B13/00 ,  H04N5/235 ,  H04N5/243 ,  G02B26/08

CPC classification number: H04N5/2351 ,  G02B26/0833 ,  H04N5/2354 ,  H04N5/243 ,  H04N5/335

Abstract: An imaging system and method that captures compressive sensing (CS) measurements of a received light stream, and also obtains samples of background light level (BGLL). The BGLL samples may be used to compensate the CS measurements for variations in the BGLL. The system includes: a light modulator to spatially modulate the received light stream with spatial patterns, and a lens to concentrate the modulated light stream onto a light detector. The samples of BGLL may be obtained in various ways: (a) injecting calibration patterns among the spatial patterns; (b) measuring complementary light reflected by digital micromirrors onto a secondary output path; (c) separating and measuring a portion of light from the optical input path; (d) low-pass filtering the CS measurements; and (e) employing a light power meter with its own separate input path. Also, the CS measurements may be high-pass filtered to attenuate background light variation.

Abstract translation: 捕获接收的光流的压缩感测（CS）测量的成像系统和方法，并且还获得背景光级（BGLL）的样本。 BGLL样本可用于补偿BGLL中的变化的CS测量。 该系统包括：用空间模式对接收到的光流进行空间调制的光调制器，以及将调制光流集中到光检测器上的透镜。 BGLL的样本可以以各种方式获得：（a）在空间图案之间注入校准图案; （b）测量由数字微镜反射到辅助输出路径上的互补光; （c）分离和测量来自光学输入路径的一部分光; （d）CS测量的低通滤波; 和（e）使用具有其自己的独立输入路径的光功率计。 此外，CS测量可以被高通滤波以衰减背景光的变化。

公开(公告)号：US09277139B2

公开(公告)日：2016-03-01

申请号：US14154817

申请日：2014-01-14

Applicant: InView Technology Corporation

Inventor： Matthew A. Herman

IPC: H04N5/228 ,  H04N5/265 ,  H04N5/335

CPC classification number: H04N5/265 ,  G06K2009/4695 ,  H03M7/3062 ,  H04N5/335

Abstract: A methodology for acquiring measurements of a signal at one or more scales of resolution, including: generating modulation patterns based on a predefined measurement matrix; modulating a received signal with the modulation patterns using the signal modulating array to obtain a modulated signal; and acquiring measurements of intensity of the modulated signal. Each modulation pattern is generated by: (a) selecting a corresponding row of the measurement matrix; (b) reordering elements of the selected row according to a permutation to obtain a reordered row; and (c) transferring the reordered row to the signal modulating array so that elements of the reordered row are mapped onto the signal modulating array. The permutation is defined so that a subset of the modulation patterns are coarse patterns that respect a partition of the signal modulating array into an array of superpixels, each superpixel including a respective group of the signal modulating elements.

Abstract translation: 一种用于以一个或多个分辨率尺度获取信号的测量的方法，包括：基于预定义的测量矩阵产生调制模式; 使用所述信号调制阵列调制具有所述调制图案的接收信号以获得调制信号; 并获取调制信号强度的测量值。 每个调制模式通过以下方式产生：（a）选择测量矩阵的相应行; （b）根据排列对所选择的行的元素重新排序以获得重新排序的行; 和（c）将重新排序的行传送到信号调制阵列，使得重新排序的行的元素被映射到信号调制阵列上。 定义排列，使得调制图案的子集是将信号调制阵列的分区相对于超像素阵列的粗略图案，每个超像素包括相应的信号调制元件组。

公开(公告)号：US20140211000A1

公开(公告)日：2014-07-31

申请号：US14168473

申请日：2014-01-30

Applicant: InView Technology Corporation

Inventor： Matthew A. Herman

IPC: G01C11/02

CPC classification number: H04N19/90 ,  G02B26/0833 ,  H04N19/60

Abstract: A mechanism for efficiently loading rows of an N×N transform matrix HN into a signal-modulating array. A row index m(i) that identifies a row r[m(i)] of HN is generated, where i is in the range {0, 1, . . . , L−1}; L is less than or equal to B; and m(i) is in the range {0, 1, . . . , B−1}. HN has the form HN=HFHB. HF is an F×F matrix, and HB is a B×B matrix. denotes the Kronecker product. The row r[m(i)] of HN is generated and loaded into the array. For each k in the range {1, 2, . . . , F−1}, a row r[m(i)+kB] from HN is partially loaded into the array by: loading a first subset of elements of row r[m(i)+kB] that are not currently present in the array, and not loading a second subset of elements of row r[m(i)+kB] that are currently present in the array.

Abstract translation: 用于将N×N变换矩阵HN的行有效地加载到信号调制阵列中的机制。 生成识别HN的行r [m（i）]的行索引m（i），其中i在{0,1，...中）。 。 。 ，L-1}; L小于或等于B; 并且m（i）在{0,1，... 。 。 ，B-1}。 HN具有HN = HFHB的形式。 HF是F×F矩阵，HB是B×B矩阵。 表示Kronecker产品。 HN的行r [m（i）]被生成并加载到阵列中。 对于范围{1，2，... 。 。 ，F-1}，来自HN的行r [m（i）+ kB]被部分地加载到阵列中，即：加载当前不存在的行r [m（i）+ kB]的元素的第一子集 该阵列并且不加载当前存在于该阵列中的行r [m（i）+ kB]的元素的第二子集。

公开(公告)号：US20140104487A1

公开(公告)日：2014-04-17

申请号：US14135154

申请日：2013-12-19

Applicant: InView Technology Corporation

Inventor： Robert F. Bridge ,  Matthew A. Herman ,  Donna E. Hewitt ,  Tyler H. Weston ,  Justin A. Fritz

IPC: H04N5/235

CPC classification number: H04N5/2351 ,  G02B26/0833 ,  H04N5/2354 ,  H04N5/243 ,  H04N5/335

Abstract: An imaging system and method that captures compressive sensing (CS) measurements of a received light stream, and also obtains samples of background light level (BGLL). The BGLL samples may be used to compensate the CS measurements for variations in the BGLL. The system includes: a light modulator to spatially modulate the received light stream with spatial patterns, and a lens to concentrate the modulated light stream onto a light detector. The samples of BGLL may be obtained in various ways: (a) injecting calibration patterns among the spatial patterns; (b) measuring complementary light reflected by digital micromirrors onto a secondary output path; (c) separating and measuring a portion of light from the optical input path; (d) low-pass filtering the CS measurements; and (e) employing a light power meter with its own separate input path. Also, the CS measurements may be high-pass filtered to attenuate background light variation.

Abstract translation: 捕获接收的光流的压缩感测（CS）测量的成像系统和方法，并且还获得背景光级（BGLL）的样本。 BGLL样本可用于补偿BGLL中的变化的CS测量。 该系统包括：用空间模式对接收到的光流进行空间调制的光调制器，以及将调制光流集中到光检测器上的透镜。 BGLL的样本可以以各种方式获得：（a）在空间图案之间注入校准图案; （b）测量由数字微镜反射到辅助输出路径上的互补光; （c）分离和测量来自光学输入路径的一部分光; （d）CS测量的低通滤波; 和（e）使用具有其自己的独立输入路径的光功率计。 此外，CS测量可以被高通滤波以衰减背景光的变化。

公开(公告)号：US09460052B2

公开(公告)日：2016-10-04

申请号：US14137206

申请日：2013-12-20

Applicant: InView Technology Corporation

Inventor： Thomas A. Goldstein ,  Matthew A. Herman

IPC: G06F17/10 ,  G06T9/00 ,  H04N19/90

CPC classification number: G06F17/10 ,  G06T9/00 ,  H04N19/90

Abstract: A mechanism for reconstructing a signal (e.g., an image) based on a vector s, which includes measurements of the signal. The measurements have been acquired using at least a portion of a measurement vector set represented by a matrix H. Each of the measurements corresponds to a respective row of the matrix H. (For example, each of the measurements may correspond to an inner product between the signal and a respective row of the matrix product HD, wherein D is a generalized permutation matrix.) A total-variation primal-dual hybrid gradient (TV-PDHG) algorithm is executed based on data including the matrix H and the vector s, to determine an estimate for the signal. The TV-PDHG algorithm is implemented in fixed-point arithmetic.

Abstract translation: 一种用于基于矢量s重建信号（例如，图像）的机制，其包括信号的测量。 使用由矩阵H表示的测量向量集的至少一部分已经获得了测量。每个测量对应于矩阵H的相应行。（例如，每个测量可以对应于 信号和矩阵乘积HD的相应行，其中D是广义置换矩阵。）基于包括矩阵H和向量s的数据执行总变异原始双双混合梯度（TV-PDHG）算法， 以确定信号的估计。 TV-PDHG算法以定点算法实现。

公开(公告)号：US09081731B2

公开(公告)日：2015-07-14

申请号：US14169903

申请日：2014-01-31

Applicant: InView Technology Corporation

Inventor： Matthew A. Herman ,  Tyler H. Weston

IPC: H04N19/112 ,  G06F17/14 ,  G06T9/00 ,  G06T1/00 ,  H04N5/232

CPC classification number: G06F17/145 ,  G06T1/0007 ,  G06T9/00 ,  H04N5/23229 ,  H04N19/90

Abstract: If a Hadamard matrix HN of order N=BF is a Kronecker product HFHB of an order F Hadamard matrix and an order B Hadamard matrix, then transformation by HN may be implemented by a fast Hadamard transform at coarse scale followed by fast Hadamard transforms at fine scale. Alternatively, transformation by HN may be achieved by performing order B transforms on columns of a two-dimensional array and order B transforms on rows of the array. As another alternative, transformation by HN may be achieved by computing intermediate values based on linear combinations of input elements and then computing linear combinations of the intermediate values. For compressive signal acquisition, any row of HN may be generated by concatenating selectively modified copies of a corresponding row of HB. Thus, modulation patterns may be generated on the fly.

Abstract translation: 如果阶N = BF的Hadamard矩阵HN是F阶Hadamard矩阵的Kronecker积HFHB和B阶Hadamard矩阵，则HN的变换可以通过在粗尺度上的快速Hadamard变换来实现，随后是快速Hadamard变换 规模。 或者，可以通过对二维阵列的列执行B阶变换并且对阵列的行上的阶数B进行变换来实现HN的变换。 作为另一替代方案，可以通过基于输入元素的线性组合计算中间值，然后计算中间值的线性组合来实现HN的变换。 对于压缩信号采集，可以通过连接HB的相应行的选择性修改的副本来生成任何HN行。 因此，可以在飞行中产生调制模式。

公开(公告)号：US08970740B2

公开(公告)日：2015-03-03

申请号：US14106542

申请日：2013-12-13

Applicant: InView Technology Corporation

Inventor： Matthew A. Herman ,  Donna E. Hewitt ,  Tyler H. Weston ,  Lenore McMackin

IPC: H04N5/217 ,  G06T5/00 ,  G06T5/50

CPC classification number: G06T5/001 ,  G06T5/50 ,  G06T2207/10052 ,  G06T2207/20212

Abstract: A mechanism for reconstructing sub-images based on measurement data acquired by an imaging system including an array of light modulating elements and an array of photodetectors. Each sub-image is reconstructed based on samples from a respective photodetector and a respective set of measurement patterns defined on a respective virtual sub-region on the modulating array. Each virtual sub-region is configured to include at least the light modulating elements that are able to send a non-trivial amount of light to the respective photodetector during a pattern application period. The virtual sub-regions overlap because many light modulating elements are capable of sending light to more than one photodetector. Whenever a measurement pattern of one virtual sub-region overlaps the measurement pattern of a neighboring virtual sub-region, the two measurement patterns agree by design. Thus, the measurement patterns for the collection of virtual sub-regions combine to form a pattern on the whole modulating array.

Abstract translation: 一种用于基于由包括光调制元件阵列和光电检测器阵列的成像系统获取的测量数据重建子图像的机构。 基于来自相应光电检测器的样本和在调制阵列上的相应虚拟子区域上定义的相应的一组测量图案重建每个子图像。 每个虚拟子区域被配置为至少包括能够在图案应用周期期间向相应光电检测器发送不平凡量的光的光调制元件。 虚拟子区域重叠，因为许多光调制元件能够向多于一个的光电检测器发送光。 每当一个虚拟子区域的测量图案与相邻虚拟子区域的测量图案重叠时，两个测量图案被设计一致。 因此，用于收集虚拟子区域的测量模式组合在整个调制阵列上形成图案。

公开(公告)号：US20140297703A1

公开(公告)日：2014-10-02

申请号：US14137206

申请日：2013-12-20

Applicant: InView Technology Corporation

Inventor： Thomas A. Goldstein ,  Matthew A. Herman

IPC: G06F17/16

CPC classification number: G06F17/10 ,  G06T9/00 ,  H04N19/90

Abstract: A mechanism for reconstructing a signal (e.g., an image) based on a vector s, which includes measurements of the signal. The measurements have been acquired using at least a portion of a measurement vector set represented by a matrix H. Each of the measurements corresponds to a respective row of the matrix H. (For example, each of the measurements may correspond to an inner product between the signal and a respective row of the matrix product HD, wherein D is a generalized permutation matrix.) A total-variation primal-dual hybrid gradient (TV-PDHG) algorithm is executed based on data including the matrix H and the vector s, to determine an estimate for the signal. The TV-PDHG algorithm is implemented in fixed-point arithmetic.

Abstract translation: 一种用于基于矢量s重建信号（例如，图像）的机制，其包括信号的测量。 使用由矩阵H表示的测量向量集的至少一部分已经获得了测量。每个测量对应于矩阵H的相应行。（例如，每个测量可以对应于 信号和矩阵乘积HD的相应行，其中D是广义置换矩阵。）基于包括矩阵H和向量s的数据执行总变异原始双双混合梯度（TV-PDHG）算法， 以确定信号的估计。 TV-PDHG算法以定点算法实现。

公开(公告)号：US20150116563A1

公开(公告)日：2015-04-30

申请号：US14527459

申请日：2014-10-29

Applicant: InView Technology Corporation

Inventor： Matthew A. Herman ,  Justin A. Fritz

IPC: H04N5/378

CPC classification number: H04N5/378 ,  H03M7/3062

Abstract: A technique to collect measurements that are adapted to a signal/scene of interest is presented. The measurements are correlations with patterns that serve as modulating waveforms. The patterns correspond respectively to rows of a sensing matrix. The method uses a sensing matrix whose rows are partitioned into blocks. Each block corresponds to a distinct feature or salient property of the scene. For each block, the method collects a number of measurements of the signal/scene based on selected rows of the block, and generates one or more associated statistics for the block based on said measurements. The statistics for the blocks are then analyzed (e.g., sorted) to determine the most important blocks. Subsequent measurements of the signal/scene may be based on rows from those most important blocks. The original measurements and/or the subsequent measurements may then be used in an algorithm to reconstruct the signal/scene.

Abstract translation: 提出了收集适合于感兴趣的信号/场景的测量的技术。 测量结果与用作调制波形的图形相关。 这些图案分别对应于感测矩阵的行。 该方法使用其行被划分成块的感测矩阵。 每个块对应于场景的不同特征或突出特性。 对于每个块，该方法基于块的所选行收集信号/场景的多个测量值，并且基于所述测量生成用于块的一个或多个相关联的统计信息。 然后分析（例如，排序）块的统计信息以确定最重要的块。 信号/场景的后续测量可以基于来自那些最重要的块的行。 然后可以在算法中使用原始测量和/或后续测量来重构信号/场景。