HAPTICS METADATA IN A SPECTATING STREAM
    92.
    发明申请

    公开(公告)号:WO2021021387A1

    公开(公告)日:2021-02-04

    申请号:PCT/US2020/040841

    申请日:2020-07-04

    Inventor: OSMAN, Steven

    Abstract: Metadata (216) indicating demanded haptic events during playback of an audio video (AV) stream (210) is embedded with the AV stream, such that the metadata can be extracted during AV playback and rendered on the player's side (202) as demanded. In this way, previously recorded video can be spectated during playback without losing whatever haptic experiences may have been generated for original playback without having to rely on merely deriving haptic events from audio.

    LOCAL GAME EXECUTION FOR SPECTATING AND SPECTATOR GAME PLAY

    公开(公告)号:WO2021021341A1

    公开(公告)日:2021-02-04

    申请号:PCT/US2020/038755

    申请日:2020-06-19

    Abstract: A method for gaming. The method including instantiating an instance of a video game at a local device of a spectator. Game state and user data of one or more players participating in a gaming session is received. Video frames are generated of live game play by the players using the game state and user data by executing the video game in the instance. Video frames are displayed for the live game play on a display of the spectator. A local game slice of the video game is generated for a sliced game play while executing the video game in the instance. The local game slice being responsive to inputs from a controller device of the spectator.

    CONTEXT-BASED USER INTERFACE MENU WITH SELECTABLE ACTIONS

    公开(公告)号:WO2020205292A1

    公开(公告)日:2020-10-08

    申请号:PCT/US2020/024049

    申请日:2020-03-20

    Abstract: Techniques for better information sharing and control switching in a graphical user interface (GUI) are described. In an example, a computer system determines a user context indicating a likely user interest in applications. Upon a user request for a menu, windows are added to a dynamic area of the menu based on the user context and correspond to the applications. The menu is presented in the GUI and each window be shown in a glanced state to provide quick information about the corresponding application. When the user focus shifts to a window, that window is presented in a focused state to also provide a selectable action that can be performed. Upon a user selection of the window, the window is presented in a selected state to further provide additional performable actions. The window can be pinned to the GUI and user control can automatically switch to another application.

    MOTION TRANSFER OF HIGHLY DIMENSIONAL MOVEMENTS TO LOWER DIMENSIONAL ROBOT MOVEMENTS

    公开(公告)号:WO2020185357A1

    公开(公告)日:2020-09-17

    申请号:PCT/US2020/018590

    申请日:2020-02-18

    Abstract: Techniques for transferring highly dimensional movements to lower dimensional robot movements are described. In an example, a reference motion of a target is used to train a non-linear approximator of a robot to learn how to perform the motion. The robot and the target are associated with a robot model and a target model, respectively. Features related to the positions of the robot joints are input to the non-linear approximator. During the training, a robot joint is simulated, which results in movement of this joint and different directions of a robot link connected thereto. The robot link is mapped to a link of the target model. The directions of the robot link are compared to the direction of the target link to learn the best movement of the robot joint. The training is repeated for the different links and for different phases of the reference motion.

    THERMOPILE ARRAY FUSION TRACKING
    97.
    发明申请

    公开(公告)号:WO2020185356A1

    公开(公告)日:2020-09-17

    申请号:PCT/US2020/018584

    申请日:2020-02-18

    Abstract: A simultaneous location and mapping (SLAM)-enabled video game system, a user device of the video game system, and a computer-readable storage medium of the user device are disclosed. Generally, the video game system includes a video game console, a plurality of thermal beacons, and a user device communicatively coupled with the video game console. The user device includes a thermopile array, a processor, and a memory. The user device may receive thermal data from the thermopile array, the thermal data corresponding to a thermal signal emitted from a thermal beacon of the plurality of thermal beacons and detected by the thermopile array. The user device may determine, based on the thermal data, its location in 3D space, and then transmit that location to the video game system.

    SYSTEM AND METHOD FOR CONVERTING IMAGE DATA INTO A NATURAL LANGUAGE DESCRIPTION

    公开(公告)号:WO2020112808A1

    公开(公告)日:2020-06-04

    申请号:PCT/US2019/063298

    申请日:2019-11-26

    Abstract: For image captioning such as for computer game images or other images, bottom-up attention (400) is combined with top-down attention (402) to provide a multi-level residual attention-based image captioning model. A residual attention mechanism (500) is first applied in the Faster R-CNN network to learn better feature representations for each region by taking spatial information into consideration. In the image captioning network, taking the extracted regional features as input, a second residual attention network (1204) is implemented to fuse the regional features attentionally for subsequent caption generation.

Patent Agency Ranking