Invention Grant
- Patent Title: Coordinated audiovisual montage from selected crowd-sourced content with alignment to audio baseline
-
Application No.: US14739910Application Date: 2015-06-15
-
Publication No.: US10971191B2Publication Date: 2021-04-06
- Inventor: Mark T. Godfrey , Turner Evan Kirk , Ian S. Simon , Nick Kruge
- Applicant: Smule, Inc.
- Applicant Address: US CA San Francisco
- Assignee: Smule, Inc.
- Current Assignee: Smule, Inc.
- Current Assignee Address: US CA San Francisco
- Agency: Haynes and Boone, LLP
- Main IPC: G10L25/57
- IPC: G10L25/57 ; G11B27/031 ; H04N21/854 ; G11B27/10 ; G06F16/68 ; G10L25/48 ; G06F3/0481 ; H04N21/414 ; G10L25/54

Abstract:
A generally diverse set of audiovisual clips is sourced from one or more repositories for use in preparing a coordinated audiovisual work. In some cases, audiovisual clips are retrieved using tags such as user-assigned hashtags or metadata. Pre-existing associations of such tags can be used as hints that certain audiovisual clips are likely to share correspondence with an audio signal encoding of a particular song or other audio baseline. Clips are evaluated for computationally determined correspondence with an audio baseline track. In general, comparisons of audio power spectra, of rhythmic features, tempo, pitch sequences and other extracted audio features may be used to establish correspondence. For clips exhibiting a desired level of correspondence, computationally determined temporal alignments of individual clips with the baseline audio track are used to prepare a coordinated audiovisual work that mixes the selected audiovisual clips with the audio track.
Public/Granted literature
- US20150279427A1 Coordinated Audiovisual Montage from Selected Crowd-Sourced Content with Alignment to Audio Baseline Public/Granted day:2015-10-01
Information query