公开(公告)号：WO2020072972A1

公开(公告)日：2020-04-09

申请号：PCT/US2019/054819

申请日：2019-10-04

Applicant: MAGIC LEAP, INC. ,  MOHAN, Anush ,  TAYLOR, Robert, Blake ,  MIRANDA, Jeremy, Dwayne ,  TORRES, Rafael, Domingos ,  OLSHANSKY, Daniel ,  SHAROKNI, Ali ,  GUENDELMAN, Eran ,  KRAMER, Nick ,  TOSSELL, Ken ,  MILLER, Samuel A. ,  TAJIK, Jehangir ,  SWAMINATHAN, Ashwin ,  AGARWAL, Lomesh ,  SINGHAL, Prateek ,  HOLDER, Joel, David ,  ZHAO, Xuan ,  CHOUDHARY, Siddharth ,  SUZUKI, Helder, Toshiro ,  BAROT, Hiral, Honar

Inventor： MOHAN, Anush ,  TAYLOR, Robert, Blake ,  MIRANDA, Jeremy, Dwayne ,  TORRES, Rafael, Domingos ,  OLSHANSKY, Daniel ,  SHAHROKNI, Ali ,  GUENDELMAN, Eran ,  KRAMER, Nick ,  TOSSELL, Ken ,  MILLER, Samuel A. ,  TAJIK, Jehangir ,  SWAMINATHAN, Ashwin ,  AGARWAL, Lomesh ,  SINGHAL, Prateek ,  HOLDER, Joel, David ,  ZHAO, Xuan ,  CHOUDHARY, Siddharth ,  SUZUKI, Helder, Toshiro ,  BAROT, Hiral, Honar ,  MOORE, Christian Ivan Robert

IPC: G06T19/00 ,  G06F3/0482 ,  G06F3/0486 ,  G06K9/46 ,  G06K9/52 ,  G06F3/04815 ,  G06K9/00671 ,  G06K9/00765 ,  G06K9/4671 ,  G06K9/629 ,  G06T19/006

Abstract: A cross reality system that provides an immersive user experience by storing persistent spatial information about the physical world that one or multiple user devices can access to determine position within the physical world and that applications can access to specify the position of virtual objects within the physical world. Persistent spatial information enables users to have a shared virtual, as well as physical, experience when interacting with the cross reality system. Further, persistent spatial information may be used in maps of the physical world, enabling one or multiple devices to access and localize into previously stored maps, reducing the need to map a physical space before using the cross reality system in it. Persistent spatial information may be stored as persistent coordinate frames, which may include a transformation relative to a reference orientation and information derived from images in a location corresponding to the persistent coordinate frame.

公开(公告)号：WO2013003783A1

公开(公告)日：2013-01-03

申请号：PCT/US2012/045060

申请日：2012-06-29

Applicant: QUALCOMM INCORPORATED ,  MAO, Yinian ,  NARAYANAN, Vidya ,  SWAMINATHAN, Ashwin

Inventor： MAO, Yinian ,  NARAYANAN, Vidya ,  SWAMINATHAN, Ashwin

IPC: H04L29/06

CPC classification number: H04L67/1044 ,  H04L9/321 ,  H04L9/3247 ,  H04L9/3268 ,  H04L63/0823 ,  H04L63/104

Abstract: Methods and apparatuses are provided for facilitating group access controls in peer-to-peer or other similar overlay networks. A group administrator may create a group in the overlay network and may assign peer-specific certificates to each member of the group for indicating membership in the group. A group member peer node can access data objects in the overlay network using its respective peer-specific certificate to authenticate itself as a group member. The authentication is performed by another peer node in the network. The validating peer node can authenticate that the group member is the rightful possessor of the peer-specific certificate using a public key associated with the peer node to which the peer-specific certificate was issued. The validating peer node can also validate that the peer-specific certificate was properly issued to the group member using a public key of the apparatus that issued the peer-specific certificate.

Abstract translation: 提供了用于促进对等或其他类似覆盖网络中的组访问控制的方法和装置。 组管理员可以在覆盖网络中创建一个组，并且可以向组中的每个成员分配对等体特定的证书以指示组中的成员资格。 组成员对等节点可以使用其各自的特定于对等体的证书来访问覆盖网络中的数据对象，以将其自身认证为组成员。 该认证由网络中的另一个对等节点执行。 验证对等节点可以使用与发布对等特定证书的对等节点相关联的公钥来认证组成员是对等特定证书的合法拥有者。 验证对等节点还可以使用发布对等体特定证书的设备的公钥来验证对等特定证书是否已正确发布给组成员。

公开(公告)号：WO2012040099A1

公开(公告)日：2012-03-29

申请号：PCT/US2011/052135

申请日：2011-09-19

Applicant: QUALCOMM INCORPORATED ,  SWAMINATHAN, Ashwin ,  SHARMA, Piyush ,  JIANG, Bolan ,  CHARI, Murali, R. ,  SPINDOLA, Serafin, Diaz ,  BAHETI, Pawan, Kumar ,  NARAYANAN, Vidya

Inventor： SWAMINATHAN, Ashwin ,  SHARMA, Piyush ,  JIANG, Bolan ,  CHARI, Murali, R. ,  SPINDOLA, Serafin, Diaz ,  BAHETI, Pawan, Kumar ,  NARAYANAN, Vidya

IPC: G06T7/00 ,  G06T7/20

CPC classification number: G06T7/246 ,  G06K9/00671 ,  G06T7/73 ,  G06T2207/10004

Abstract: A mobile platform efficiently processes sensor data, including image data, using distributed processing in which latency sensitive operations are performed on the mobile platform, while latency insensitive, but computationally intensive operations are performed on a remote server. The mobile platform acquires sensor data, such as image data, and determines whether there is a trigger event to transmit the sensor data to the server. The trigger event may be a change in the sensor data relative to previously acquired sensor data, e.g., a scene change in an image. When a change is present, the sensor data may be transmitted to the server for processing. The server processes the sensor data and returns information related to the sensor data, such as identification of an object in an image or a reference image or model. The mobile platform may then perform reference based tracking using the identified object or reference image or model.

Abstract translation: 移动平台使用在移动平台上执行延迟敏感操作的分布式处理来有效地处理包括图像数据在内的传感器数据，而延迟不敏感，但在远程服务器上执行计算密集型操作。 移动平台获取诸如图像数据的传感器数据，并且确定是否存在将传感器数据传送到服务器的触发事件。 触发事件可以是传感器数据相对于先前获取的传感器数据的变化，例如图像中的场景变化。 当存在变化时，传感器数据可以被发送到服务器进行处理。 服务器处理传感器数据并返回与传感器数据相关的信息，例如图像中的对象或参考图像或模型的识别。 然后，移动平台可以使用所识别的对象或参考图像或模型执行基于参考的跟踪。

公开(公告)号：WO2011008889A3

公开(公告)日：2011-04-21

申请号：PCT/US2010042021

申请日：2010-07-14

Applicant: QUALCOMM INC ,  SWAMINATHAN ASHWIN ,  JAYARAM RANJITH S ,  NARAYANAN VIDYA

Inventor： SWAMINATHAN ASHWIN ,  JAYARAM RANJITH S ,  NARAYANAN VIDYA

IPC: G06F7/00

CPC classification number: G06F17/30699 ,  G06F17/30675 ,  G06F17/30864 ,  G06F17/30867 ,  H04L67/104 ,  H04L67/1068 ,  H04L67/16

Abstract: Methods and apparatus are described herein for performing AND/OR searching using multiple keywords. A query is received at a first node in a network having multiple keywords. The first node determines a set of documents matching a first of the multiple keywords, and computes an ideal Bloom filter representing those keywords. The first node sends the query and the Bloom filter to a second node, which determines its search results for a second of the multiple keywords in accordance with the Bloom filter.

Abstract translation: 这里描述了使用多个关键字执行AND / OR搜索的方法和装置。 在具有多个关键字的网络中的第一节点处接收到查询。 第一个节点确定与多个关键字中的第一个匹配的一组文档，并计算一个表示这些关键字的理想的Bloom过滤器。 第一个节点将查询和布隆过滤器发送到第二个节点，根据布隆过滤器，第二节点确定多个关键字中的第二个的搜索结果。

公开(公告)号：WO2011034862A1

公开(公告)日：2011-03-24

申请号：PCT/US2010/048822

申请日：2010-09-14

Applicant: QUALCOMM INCORPORATED ,  SWAMINATHAN, Ashwin ,  PEDRALI-NOY, Marzio

Inventor： SWAMINATHAN, Ashwin ,  PEDRALI-NOY, Marzio

IPC: H03K3/037 ,  H03K3/356

CPC classification number: H03K3/0375 ,  H03K3/356156

Abstract: A latching element (124) latches incoming data (D(7:0)) into an integrated circuit (101). The latching element (for example, a latch or flip-flop) can be considered to include a data path portion (126), a clock path portion (127), and an ideal latching element (125). In one embodiment, an open-loop replica (118) of the data path portion (126) is disposed in a clock signal path between a clock input terminal (116) of the integrated circuit and a clock input lead (130) of the latching element. In a second embodiment, an additional replica (144) of the clock path portion is disposed in a data signal path between a data terminal (105) of the integrated circuit (101) and a data input lead (128) of the latching element. The replica circuits (118,144) help prevent changes in skew between a data path propagation time to the ideal latching element and clock path propagation time to the ideal latching element. Setup times remain substantially constant over PVT (process, supply voltage, temperature).

Abstract translation: 锁存元件（124）将输入数据（D（7：0））锁存到集成电路（101）中。 锁存元件（例如，锁存器或触发器）可以被认为包括数据路径部分（126），时钟路径部分（127）和理想锁存元件（125）。 在一个实施例中，数据路径部分（126）的开环复制品（118）被布置在集成电路的时钟输入端（116）和时钟输入引线（130）之间的时钟信号路径中， 元件。 在第二实施例中，时钟路径部分的附加副本（144）被布置在集成电路（101）的数据终端（105）和锁存元件的数据输入引线（128）之间的数据信号路径中。 复制电路（118,144）有助于防止在理想锁存元件的数据路径传播时间与理想锁存元件的时钟路径传播时间之间的偏差变化。 PVT（工艺，电源电压，温度）的设置时间基本保持不变。

公开(公告)号：WO2022174263A1

公开(公告)日：2022-08-18

申请号：PCT/US2022/070642

申请日：2022-02-11

Applicant: MAGIC LEAP, INC. ,  ZHOU, Lipu ,  SWAMINATHAN, Ashwin ,  AGARWAL, Lomesh

Inventor： ZHOU, Lipu ,  SWAMINATHAN, Ashwin ,  AGARWAL, Lomesh

IPC: G06F3/01 ,  G01C21/20 ,  G01S7/48 ,  G01S17/42 ,  G01S17/89

Abstract: Disclosed here in are systems and methods for mapping environment information. In some embodiments, the systems and methods are configured for mapping information in a mixed reality environment. In some embodiments, the system is configured to perform a method including scanning an environment including capturing, with a sensor, a plurality of points of the environment; tracking a plane of the environment; updating observations associated with the environment by inserting a keyframe into the observations; determining whether the plane is coplanar with a second plane of the environment; in accordance with a determination that the plane is coplanar with the second plane, performing planar bundle adjustment on the observations associated with the environment; and in accordance with a determination that the plane is not coplanar with the second plane, performing planar bundle adjustment on a portion of the observations associated with the environment.

公开(公告)号：WO2013032785A1

公开(公告)日：2013-03-07

申请号：PCT/US2012/051737

申请日：2012-08-21

Applicant: QUALCOMM INCORPORATED ,  YI, Sheng ,  SWAMINATHAN, Ashwin ,  JIANG, Bolan ,  NAJAFI SHOUSHTARI, Seyed Hesameddin

Inventor： YI, Sheng ,  SWAMINATHAN, Ashwin ,  JIANG, Bolan ,  NAJAFI SHOUSHTARI, Seyed Hesameddin

IPC: G06T7/20

CPC classification number: G06T7/251 ,  G06T2207/10016

Abstract: A vision based tracking system in a mobile platform tracks objects using groups of detected lines. The tracking system detects lines in a captured image of the object to be tracked. Groups of lines are formed from the detected lines. The groups of lines may be formed by computing intersection points of the detected lines and using intersection points to identified connected lines, where the groups of lines are formed using connected lines. A graph of the detected lines may be constructed and intersection points identified. Interesting subgraphs are generated using the connections and the group of lines is formed with the interesting subgraphs. Once the groups of lines are formed, the groups of lines are used to track the object, e.g., by comparing the groups of lines in a current image of the object to groups of lines in a previous image of the object.

Abstract translation: 移动平台中的基于视觉的跟踪系统使用检测到的线路组跟踪对象。 跟踪系统检测要跟踪的对象的捕获图像中的线。 线组由检测线形成。 线组可以通过计算所检测的线的交点并使用交叉点来识别连接的线来形成，其中使用连接的线形成线组。 可以构建检测到的线的图形，并确定交点。 使用连接生成有趣的子图，并且组的线条与有趣的子图形成。 一旦形成了一组线条，例如通过将对象的当前图像中的线组与对象的先前图像中的线组进行比较来将线组用于跟踪对象。

公开(公告)号：WO2012034092A1

公开(公告)日：2012-03-15

申请号：PCT/US2011051109

申请日：2011-09-09

Applicant: QUALCOMM INC ,  JIANG BOLAN ,  SWAMINATHAN ASHWIN ,  SPINDOLA SERAFIN DIAZ ,  AHUJA DHEERAJ ,  SWEET III CHARLES WHEELER

Inventor： JIANG BOLAN ,  SWAMINATHAN ASHWIN ,  SPINDOLA SERAFIN DIAZ ,  AHUJA DHEERAJ ,  SWEET III CHARLES WHEELER

IPC: G06T7/00

CPC classification number: G06T7/74 ,  G06T19/006 ,  G06T2207/10004 ,  G06T2207/30244

Abstract: A multi-user augmented reality (AR) system operates without a previously acquired common reference by generating a reference image on the fly. The reference image is produced by capturing at least two images of a planar object and using the images to determine a pose (position and orientation) of a first mobile platform with respect to the planar object. Based on the orientation of the mobile platform, an image of the planar object, which may be one of the initial images or a subsequently captured image, is warped to produce the reference image of a front view of the planar object. The reference image may be produced by the mobile platform or by, e.g., a server. Other mobile platforms may determine their pose with respect to the planar object using the reference image to perform a multi-user augmented reality application.

Abstract translation: 多用户增强现实（AR）系统通过即时生成参考图像而无需先前获取的公共参考。 通过捕获平面物体的至少两个图像并使用图像来确定第一移动平台相对于平面对象的姿势（位置和方位）来产生参考图像。 基于移动平台的方向，可以将平面对象的图像（其可以是初始图像之一或随后的拍摄图像）扭曲，以产生平面对象的前视图的参考图像。 参考图像可以由移动平台或者例如由服务器产生。 其他移动平台可以使用参考图像来确定其相对于平面对象的姿态来执行多用户增强现实应用。

公开(公告)号：WO2012016168A2

公开(公告)日：2012-02-02

申请号：PCT/US2011045942

申请日：2011-07-29

Applicant: QUALCOMM INC ,  BAHETI PAWAN KUMAR ,  VADDADI SUNDEEP ,  SWAMINATHAN ASHWIN ,  REZNIK YURIY ,  HAMSICI ONUR C ,  CHARI MURALI RAMASWAMY ,  HONG JOHN H ,  LEE CHONG UK

Inventor： BAHETI PAWAN KUMAR ,  VADDADI SUNDEEP ,  SWAMINATHAN ASHWIN ,  REZNIK YURIY ,  HAMSICI ONUR C ,  CHARI MURALI RAMASWAMY ,  HONG JOHN H ,  LEE CHONG UK

IPC: G06K9/46

CPC classification number: G06K9/6857 ,  G06K9/4671

Abstract: In one example, an apparatus includes a processor configured to extract a first set of one or more keypoints from a first set of blurred images of a first octave of a received image, calculate a first set of one or more descriptors for the first set of keypoints, receive a confidence value for a result produced by querying a feature descriptor database with the first set of descriptors, wherein the result comprises information describing an identity of an object in the received image, and extract a second set of one or more keypoints from a second set of blurred images of a second octave of the received image when the confidence value does not exceed a confidence threshold. In this manner, the processor may perform incremental feature descriptor extraction, which may improve computational efficiency of object recognition in digital images.

Abstract translation: 在一个示例中，一种装置包括处理器，该处理器被配置为从接收到的图像的第一八度的第一组模糊图像中提取第一组一个或多个关键点，计算第一组的一个或多个描述符 接收关于通过用第一组描述符查询特征描述符数据库产生的结果的置信度值，其中所述结果包括描述所接收的图像中的对象的身份的信息，并且从第二组关键点提取一个或多个关键点 当置信度值不超过置信度阈值时，所接收图像的第二八度音阶的第二组模糊图像。 以这种方式，处理器可以执行递增特征描述符提取，这可以提高数字图像中对象识别的计算效率。

公开(公告)号：WO2010144889A1

公开(公告)日：2010-12-16

申请号：PCT/US2010/038440

申请日：2010-06-11

Applicant: QUALCOMM INCORPORATED ,  SWAMINATHAN, Ashwin ,  JAYARAM, Ranjith S. ,  NARAYANAN, Vidya

Inventor： SWAMINATHAN, Ashwin ,  JAYARAM, Ranjith S. ,  NARAYANAN, Vidya

IPC: H04L29/08 ,  H04L29/06

CPC classification number: H04L67/16 ,  Y10S707/99936

Abstract: Methods and apparatus for publishing services and performing queries for service in a network are described herein. Service descriptions writing in a native search description language are translated to a normalized schema. The normal schema is published to the network. Queries to the network, which may be written in any native search description language, are also translated to normalized schema prior to performing the search. Accordingly, all services available can be published and located in a query without consideration of the native search description language.

Abstract translation: 本文描述了用于在网络中发布服务和执行服务查询的方法和装置。 以本地搜索描述语言编写的服务描述被转换为规范化模式。 正常模式被发布到网络。 可能以任何本地搜索描述语言编写的对网络的查询在执行搜索之前也被转换为归一化模式。 因此，所有可用的服务可以在不考虑本地搜索描述语言的情况下被发布和定位在查询中。