Invention Grant
- Patent Title: Virtual reality with interactive streaming video and likelihood-based foveation
-
Application No.: US15622836Application Date: 2017-06-14
-
Publication No.: US10560680B2Publication Date: 2020-02-11
- Inventor: Eric Horvitz , Eduardo Cuervo , David Chu
- Applicant: Microsoft Technology Licensing, LLC
- Applicant Address: US WA Redmond
- Assignee: Microsoft Technology Licensing, LLC
- Current Assignee: Microsoft Technology Licensing, LLC
- Current Assignee Address: US WA Redmond
- Agency: Fountainhead Law Group P.C.
- Main IPC: H04N13/00
- IPC: H04N13/00 ; H04N13/139 ; H04N21/2343 ; H04N21/24 ; H04N21/81 ; H04N21/4402 ; H04N13/117 ; H04N13/161 ; H04N13/194 ; H04N13/344 ; H04N13/383

Abstract:
A server may be configured to receive first pose data from a virtual reality device, generate second pose data, including a pose prediction, based at least on the first pose data, render a map representation based at least on the pose prediction, determine regions of the map representation based on a likelihood of view of each of the regions, perform foveation in each of the regions and generate an encoded frame based on the regions and a network parameter, and send the encoded frame and second pose data to the device. The encoding may associate each of the regions with a quality level and base the foveation on each region's associated quality level. The foveation may use different quantization parameters for each of the regions and/or use rendering foveation for each of regions. Network conditions such as latency, bandwidth, and/or jitter may be considered for bit allocation in the foveation.
Public/Granted literature
- US20180220119A1 VIRTUAL REALITY WITH INTERACTIVE STREAMING VIDEO AND LIKELIHOOD-BASED FOVEATION Public/Granted day:2018-08-02
Information query