公开(公告)号：US20210055905A1

公开(公告)日：2021-02-25

申请号：US16947943

申请日：2020-08-25

Applicant: SMULE, INC.

Inventor： Jon Moldover ,  David Steinwedel ,  Jeffrey C. Smith ,  Perry R. Cook

IPC: G06F3/16 ,  G06F3/0482 ,  G10L25/51 ,  G10L25/90 ,  G06F3/0484 ,  G06F3/0488

Abstract: User interface techniques provide user vocalists with mechanisms for solo audiovisual capture and for seeding subsequent performances by other users (e.g., joiners). Audiovisual capture may be against a full-length work or seed spanning much or all of a pre-existing audio (or audiovisual) work and in some cases may mix, to seed further contributions of one or more joiners, a user's captured media content for at least some portions of the audio (or audiovisual) work. A short seed or short segment may span less than all (and in some cases, much less than all) of the audio (or audiovisual) work. For example, a verse, chorus, refrain, hook or other limited “chunk” of an audio (or audiovisual) work may constitute a short seed or short segment. Computational techniques are described that allow a system to automatically identify suitable short seeds or short segments. After audiovisual capture against the short seed or short segment, a resulting, solo or group, full-length or short-form performance may be posted, livestreamed, or otherwise disseminated in a social network.

公开(公告)号：US20190355337A1

公开(公告)日：2019-11-21

申请号：US16418659

申请日：2019-05-21

Applicant: SMULE, INC.

Inventor： David Steinwedel ,  Andrea Slobodien ,  Jeffrey C. Smith ,  Perry R. Cook

IPC: G10H1/36 ,  H04N21/439 ,  H04N21/4402 ,  H04N21/466 ,  H04N21/43

Abstract: User interface techniques provide user vocalists with mechanisms for forward and backward traversal of audiovisual content, including pitch cues, waveform- or envelope-type performance timelines, lyrics and/or other temporally-synchronized content at record-time, during edits, and/or in playback. Recapture of selected performance portions, coordination of group parts, and overdubbing may all be facilitated. Direct scrolling to arbitrary points in the performance timeline, lyrics, pitch cues and other temporally-synchronized content allows user to conveniently move through a capture or audiovisual edit session. In some cases, a user vocalist may be guided through the performance timeline, lyrics, pitch cues and other temporally-synchronized content in correspondence with group part information such as in a guided short-form capture for a duet. A scrubber allows user vocalists to conveniently move forward and backward through the temporally-synchronized content.

公开(公告)号：US20180374462A1

公开(公告)日：2018-12-27

申请号：US16107351

申请日：2018-08-21

Applicant: SMULE, INC.

Inventor： David Steinwedel ,  Perry R. Cook ,  Paul T. Chi ,  Wei Zhou ,  Jon Moldover ,  Anton Holmberg ,  Jingxi Li

IPC: G10H1/36 ,  G11B27/02

Abstract: Visual effects schedules are applied to audiovisual performances with differing visual effects applied in correspondence with differing elements of musical structure. Segmentation techniques applied to one or more audio tracks (e.g., vocal or backing tracks) are used to compute some of the components of the musical structure. In some cases, applied visual effects schedules are mood-denominated and may be selected by a performer as a component of his or her visual expression or determined from an audiovisual performance using machine learning techniques.

公开(公告)号：US11972748B2

公开(公告)日：2024-04-30

申请号：US17651055

申请日：2022-02-14

Applicant: SMULE, INC.

Inventor： David Steinwedel ,  Andrea Slobodien ,  Jeffrey C. Smith ,  Perry R. Cook

IPC: G10H1/36 ,  H04L12/18

CPC classification number: G10H1/361 ,  H04L12/1813 ,  G10H2210/005 ,  G10H2220/011 ,  G10H2220/096

Abstract: User interface techniques provide user vocalists with mechanisms for seeding subsequent performances by other users (e.g., joiners). A seed may be a full-length seed spanning much or all of a pre-existing audio (or audiovisual) work and mixing, to seed further contributions of one or more joiners, a user's captured media content for at least some portions of the audio (or audiovisual) work. A short seed may span less than all (and in some cases, much less than all) of the audio (or audiovisual) work. For example, a verse, chorus, refrain, hook or other limited “chunk” of an audio (or audiovisual) work may constitute a seed. A seeding user's call invites other users to join the full-length or short-form seed by singing along, singing a particular vocal part or musical section, singing harmony or other duet part, rapping, talking, clapping, recording video, adding a video clip from camera roll, etc. The resulting group performance, whether full-length or just a chunk, may be posted, livestreamed, or otherwise disseminated in a social network.

公开(公告)号：US20230005462A1

公开(公告)日：2023-01-05

申请号：US17651055

申请日：2022-02-14

Applicant: SMULE, INC.

Inventor： David Steinwedel ,  Andrea Slobodien ,  Jeffrey C. Smith ,  Perry R. Cook

IPC: G10H1/36 ,  H04L12/18

Abstract: User interface techniques provide user vocalists with mechanisms for seeding subsequent performances by other users (e.g., joiners). A seed may be a full-length seed spanning much or all of a pre-existing audio (or audiovisual) work and mixing, to seed further contributions of one or more joiners, a user's captured media content for at least some portions of the audio (or audiovisual) work. A short seed may span less than all (and in some cases, much less than all) of the audio (or audiovisual) work. For example, a verse, chorus, refrain, hook or other limited “chunk” of an audio (or audiovisual) work may constitute a seed. A seeding user's call invites other users to join the full-length or short-form seed by singing along, singing a particular vocal part or musical section, singing harmony or other duet part, rapping, talking, clapping, recording video, adding a video clip from camera roll, etc. The resulting group performance, whether full-length or just a chunk, may be posted, livestreamed, or otherwise disseminated in a social network.

公开(公告)号：US10943574B2

公开(公告)日：2021-03-09

申请号：US16418659

申请日：2019-05-21

Applicant: SMULE, INC.

Inventor： David Steinwedel ,  Andrea Slobodien ,  Jeffrey C. Smith ,  Perry R. Cook

IPC: G10H1/36 ,  H04N21/439 ,  H04N21/4402 ,  H04N21/466 ,  H04N21/43

Abstract: User interface techniques provide user vocalists with mechanisms for forward and backward traversal of audiovisual content, including pitch cues, waveform- or envelope-type performance timelines, lyrics and/or other temporally-synchronized content at record-time, during edits, and/or in playback. Recapture of selected performance portions, coordination of group parts, and overdubbing may all be facilitated. Direct scrolling to arbitrary points in the performance timeline, lyrics, pitch cues and other temporally-synchronized content allows user to conveniently move through a capture or audiovisual edit session. In some cases, a user vocalist may be guided through the performance timeline, lyrics, pitch cues and other temporally-synchronized content in correspondence with group part information such as in a guided short-form capture for a duet. A scrubber allows user vocalists to conveniently move forward and backward through the temporally-synchronized content.

公开(公告)号：US11693616B2

公开(公告)日：2023-07-04

申请号：US16947943

申请日：2020-08-25

Applicant: SMULE, INC.

Inventor： Jon Moldover ,  David Steinwedel ,  Jeffrey C. Smith ,  Perry R. Cook

IPC: G06F3/0484 ,  G06F3/16 ,  G06F3/0482 ,  G10L25/51 ,  G06F3/0488 ,  G10L25/90

CPC classification number: G06F3/16 ,  G06F3/0482 ,  G06F3/0484 ,  G06F3/0488 ,  G10L25/51 ,  G10L25/90 ,  G06F2203/04808

Abstract: User interface techniques provide user vocalists with mechanisms for solo audiovisual capture and for seeding subsequent performances by other users (e.g., joiners). Audiovisual capture may be against a full-length work or seed spanning much or all of a pre-existing audio (or audiovisual) work and in some cases may mix, to seed further contributions of one or more joiners, a user's captured media content for at least some portions of the audio (or audiovisual) work. A short seed or short segment may span less than all (and in some cases, much less than all) of the audio (or audiovisual) work. For example, a verse, chorus, refrain, hook or other limited “chunk” of an audio (or audiovisual) work may constitute a short seed or short segment. Computational techniques are described that allow a system to automatically identify suitable short seeds or short segments. After audiovisual capture against the short seed or short segment, a resulting, solo or group, full-length or short-form performance may be posted, livestreamed, or otherwise disseminated in a social network.

公开(公告)号：US11488569B2

公开(公告)日：2022-11-01

申请号：US16107351

申请日：2018-08-21

Applicant: SMULE, INC.

Inventor： David Steinwedel ,  Perry R. Cook ,  Paul T. Chi ,  Wei Zhou ,  Jon Moldover ,  Anton Holmberg ,  Jingxi Li

IPC: G10H1/36 ,  G11B27/02 ,  G06T11/00

Abstract: Visual effects schedules are applied to audiovisual performances with differing visual effects applied in correspondence with differing elements of musical structure. Segmentation techniques applied to one or more audio tracks (e.g., vocal or backing tracks) are used to compute some of the components of the musical structure. In some cases, applied visual effects schedules are mood-denominated and may be selected by a performer as a component of his or her visual expression or determined from an audiovisual performance using machine learning techniques.

公开(公告)号：US11146901B2

公开(公告)日：2021-10-12

申请号：US16403939

申请日：2019-05-06

Applicant: SMULE, INC.

Inventor： Amanda Chaudhary ,  David Steinwedel ,  John Shimmin ,  Lance Jabr ,  Randal Leistikow

IPC: G06F17/00 ,  H04R29/00 ,  G06F3/16 ,  G10L25/60

Abstract: Latency on different devices (e.g., devices of differing brand, model, vintage, etc.) can vary significantly and tens of milliseconds can affect human perception of lagging and leading components of a performance. As a result, use of a uniform latency estimate across a wide variety of devices is unlikely to provide good results, and hand-estimating round-trip latency across a wide variety of devices is costly and would constantly need to be updated for new devices. Instead, a system has been developed for crowdsourcing latency estimates.

公开(公告)号：US20190354272A1

公开(公告)日：2019-11-21

申请号：US15985519

申请日：2018-05-21

Applicant: SMULE, INC.

Inventor： David Steinwedel ,  Andrea Slobodien ,  Paul T. Chi ,  Perry R. Cook

IPC: G06F3/0484 ,  G06F3/0488 ,  G06F3/16

Abstract: Embodiments described herein relate generally to graphical user interfaces for display screens of a musical composition authoring system presented on a display of a computing device.