Methods and apparatus for motion transfer between different media

    公开(公告)号:US12136182B2

    公开(公告)日:2024-11-05

    申请号:US17662884

    申请日:2022-05-11

    Applicant: GoPro, Inc.

    Inventor: Robert McIntosh

    Abstract: Systems, apparatus, and methods for motion transfer between different media. Two videos shot simultaneously are combined with aspects of each used to produce a higher-resolution frame interpolated video than would otherwise be possible by the devices alone. The interpolated video may be used in slow motion footage, a higher frame rate (e.g., virtual reality) application, or to add a realistic motion blur effect in post-processing (rather than in capture). A post-processing device may receive high-speed video from a high-speed camera and a low-speed video from a low-speed camera. The post-processing device may use motion data from the high-speed video to interpolate frames of (high-resolution) low-speed video producing low-speed interpolated video.

    SYSTEMS AND METHODS FOR SYNCHRONIZING INFORMATION FOR VIDEOS

    公开(公告)号:US20210344814A1

    公开(公告)日:2021-11-04

    申请号:US17153615

    申请日:2021-01-20

    Applicant: GoPro, Inc.

    Abstract: An image capture device may capture video frames while experiencing motion. The video frames may be stored in a visual track, and rotational positions of the image capture device may be stored in a rotational position track. The visual track and the rotational position track may not be temporally aligned. A looping stabilized view of the view frames and a synchronization adjustment option may be presented on a display. The synchronization adjustment option may enable user modification of timing of the rotational positions stored within the rotational position track. Timing modification of the rotational positions may cause changes in the looping stabilized view, which may be used as feedback on whether the synchronization between the visual track and the rotational position track is being improved or not by the timing modification of the rotational positions.

    Systems and methods for synchronizing information for videos

    公开(公告)号:US10924636B1

    公开(公告)日:2021-02-16

    申请号:US15929391

    申请日:2020-04-30

    Applicant: GoPro, Inc.

    Abstract: An image capture device may capture video frames while experiencing motion. The video frames may be stored in a visual track, and rotational positions of the image capture device may be stored in a rotational position track. The visual track and the rotational position track may not be temporally aligned. A looping stabilized view of the view frames and a synchronization adjustment option may be presented on a display. The synchronization adjustment option may enable user modification of timing of the rotational positions stored within the rotational position track. Timing modification of the rotational positions may cause changes in the looping stabilized view, which may be used as feedback on whether the synchronization between the visual track and the rotational position track is being improved or not by the timing modification of the rotational positions.

    Systems and methods for simulating motion blur

    公开(公告)号:US12159379B1

    公开(公告)日:2024-12-03

    申请号:US17872772

    申请日:2022-07-25

    Applicant: GoPro, Inc.

    Abstract: Video frames are captured by an image capture device and stabilized to generate stabilized video frames. Multiple stabilized video frames are combined into single motion blurred video frames. Combination of multiple stabilized video frames into single motion blurred video frames produces motion blur within the single motion blurred video frames that is both physical and real.

    SYSTEMS, METHODS, AND APPARATUS FOR PIGGYBACK CAMERA CALIBRATION

    公开(公告)号:US20240037793A1

    公开(公告)日:2024-02-01

    申请号:US17815507

    申请日:2022-07-27

    Applicant: GoPro, Inc.

    CPC classification number: G06T7/85 H04N5/2328 G06T2207/20081

    Abstract: Systems, apparatus, and methods for piggyback camera calibration. Existing piggybacked capture techniques use a “beauty camera” and an “action camera” to capture raw footage. The user directly applies the EIS stabilization track of a piggybacked action camera to the cinematic footage to create desired stable footage. Unfortunately, since the action camera may have been slightly offset from the cinematic video camera, the EIS stabilization data will only roughly approximate the necessary corrections. In other words, the user must manually fine tune the corrections. The disclosed embodiments use a calibration sequence to estimate a physical offset between the beauty camera and the action camera. Then, the estimated physical offset can be used to calculate an offset camera orientation for stabilizing the beauty camera. The foregoing process can be performed in-the-field before actual capture. This allows the user to check their set-up and fix any issues before capturing the desired footage.

    Systems, apparatus, and methods for encoding telemetry data as audio waveforms

    公开(公告)号:US12170099B2

    公开(公告)日:2024-12-17

    申请号:US17805180

    申请日:2022-06-02

    Applicant: GoPro, Inc.

    Abstract: Systems, apparatus, and methods for encoding telemetry data as audio waveforms. Action cameras may be used to capture telemetry data, which in some applications, may be more useful than its audio/visual media capture. For example, a user may desire the “look-and-feel” of one camera but would like to use the telemetry track information from an action camera. In so-called “piggybacking” operation, the user may rigidly affix the two cameras and use the video track with the telemetry track in post-processing. Unfortunately, time-aligning the two tracks can result in relative drift over time. Various embodiments of the present disclosure transfer telemetry data as data-over-audio. The data-over-audio may be sampled according to the recipient device and recorded at capture. Subsequent post-processing may be performed with the time-aligned tracks.

    Systems and methods for increasing image fidelity

    公开(公告)号:US12141950B2

    公开(公告)日:2024-11-12

    申请号:US18463922

    申请日:2023-09-08

    Applicant: GoPro, Inc.

    Inventor: Robert McIntosh

    Abstract: Image captured through a non-rectilinear lens may exhibit distortions. The distortions may be reduced by warping the image. However, warping the image may degrade the fidelity of the image. The warped image may be enhanced to increase the fidelity of the image. The enhancement may be applied to the portions of the image that were degraded from the warping.

    Motion Blur for Multilayer Motion
    9.
    发明公开

    公开(公告)号:US20240320803A1

    公开(公告)日:2024-09-26

    申请号:US18189186

    申请日:2023-03-23

    Applicant: GoPro, Inc.

    Abstract: Systems, apparatus, and methods for adding post-processing motion blur to video. Conventional post-processing techniques relied on the filmmaker to select and stage their shots. Different motion blur techniques were designed to fix certain types of footage. Vector blur is one technique that “smears” pixel information in the direction of movement. Frame interpolation and stacking attempts to create motion blur by stacking interpolated frames together. Each technique has its own set of limitations. Various embodiments use a combination of motion blur techniques in post-processing for better, more realistic outcomes with faster/more efficient rendering times. In some cases, this may enable adaptive quality post-processing that may be performed in mobile/embedded ecosystems.

    METHODS AND APPARATUS FOR FRAME INTERPOLATION WITH OCCLUDED MOTION

    公开(公告)号:US20240320786A1

    公开(公告)日:2024-09-26

    申请号:US18358293

    申请日:2023-07-25

    Applicant: GoPro, Inc.

    Inventor: Robert McIntosh

    Abstract: Systems, apparatus, and methods adding post-processing motion blur to video and/or frame interpolation with occluded motion. Conventional post-processing techniques relied on the filmmaker to select and stage their shots. Different motion blur techniques were designed to fix certain types of footage. Vector blur is one technique that “smears” pixel information in the direction of movement. Frame interpolation and stacking attempts to create motion blur by stacking interpolated frames together. Each technique has its own set of limitations. Various embodiments use a combination of motion blur techniques in post-processing for better, more realistic outcomes with faster/more efficient rendering times. In some cases, this may enable adaptive quality post-processing that may be performed in mobile/embedded ecosystems. Various embodiments use a combination of video frame interpolation techniques for better interpolated frames with faster/more efficient rendering times.

Patent Agency Ranking