-
公开(公告)号:US20240311962A1
公开(公告)日:2024-09-19
申请号:US18308725
申请日:2023-04-28
Applicant: Intel Corporation
Inventor: Darshan R. Iyer , Deepak Vembar , Changliang Wang , Sumit Bhatia
CPC classification number: G06T3/4046 , G06T3/18 , G06T5/70 , G06T7/20
Abstract: Described herein are techniques to enhance the user experience for 3D rendered applications via neural frame generation using upsampled optical flow data. In one embodiment, a neural network is trained using both sparse optical flow data and dense optical flow data to enable neural frame generation to be performed by a deployed neural network using only sparse optical flow data. The sparse optical flow data can be upsampled to dense optical flow data by the trained neural network. The neural network can then use the upsampled dense optical flow data to perform frame generation.
-
公开(公告)号:US20240303899A1
公开(公告)日:2024-09-12
申请号:US18179216
申请日:2023-03-06
Applicant: Intel Corporation
Inventor: Darshan R. Iyer , Deepak Vembar
CPC classification number: G06T15/005 , G06T3/18 , G06T3/4007 , G06T3/4046 , G06T7/20 , G06T9/002 , G06T2207/10024 , G06T2207/20081 , G06T2207/20084 , G06T2210/52
Abstract: Described herein are techniques to enhance the user experience for 3D rendered applications via neural frame generation and neural supersampling. One embodiment provides a latency aware unified neural network for frame interpolation and extrapolation. This unified neural network merges interpolation and extrapolation networks into one generalized network that can be applied to both interpolation and extrapolation, depending on the acceptable latency of performance. A further embodiment provides hardware-efficient and latency-aware spatiotemporal neural frame prediction. Hardware-efficient and latency-aware spatiotemporal neural frame prediction enables both frame generation and machine learning supersampling using a single network, rather than using separate networks for frame generation and supersampling.
-