公开(公告)号：US20180374462A1

公开(公告)日：2018-12-27

申请号：US16107351

申请日：2018-08-21

Applicant: SMULE, INC.

Inventor： David Steinwedel ,  Perry R. Cook ,  Paul T. Chi ,  Wei Zhou ,  Jon Moldover ,  Anton Holmberg ,  Jingxi Li

IPC: G10H1/36 ,  G11B27/02

Abstract: Visual effects schedules are applied to audiovisual performances with differing visual effects applied in correspondence with differing elements of musical structure. Segmentation techniques applied to one or more audio tracks (e.g., vocal or backing tracks) are used to compute some of the components of the musical structure. In some cases, applied visual effects schedules are mood-denominated and may be selected by a performer as a component of his or her visual expression or determined from an audiovisual performance using machine learning techniques.

公开(公告)号：US20180288467A1

公开(公告)日：2018-10-04

申请号：US15944537

申请日：2018-04-03

Applicant: SMULE, INC.

Inventor： Anton Holmberg ,  Benjamin Hersh ,  Jeannie Yang ,  Perry R. Cook ,  Jeffrey C. Smith

IPC: H04N21/43 ,  H04N21/4788 ,  H04L29/06 ,  H04L29/08

Abstract: Techniques have been developed to facilitate the livestreaming of group audiovisual performances. Audiovisual performances including vocal music are captured and coordinated with performances of other users in ways that can create compelling user and listener experiences. For example, in some cases or embodiments, duets with a host performer may be supported in a sing-with-the-artist style audiovisual livestream in which aspiring vocalists request or queue particular songs for a live radio show entertainment format. The developed techniques provide a communications latency-tolerant mechanism for synchronizing vocal performances captured at geographically-separated devices (e.g., at globally-distributed, but network-connected mobile phones or tablets or at audiovisual capture devices geographically separated from a live studio).

公开(公告)号：US20180151161A1

公开(公告)日：2018-05-31

申请号：US15667372

申请日：2017-08-02

Applicant: SMULE, INC.

Inventor： Charles Espeleta ,  Jeannie Yang ,  Perry R. Cook ,  Oscar Corral ,  Jonathan Moody ,  Ran Xie ,  Jeffrey C. Smith ,  Dean Schaffer

IPC: G10H1/00 ,  G10H1/32 ,  G10H1/36

CPC classification number: G10H1/0016 ,  G10H1/32 ,  G10H1/361 ,  G10H1/368 ,  G10H2210/091 ,  G10H2210/555 ,  G10H2210/571 ,  G10H2220/096 ,  G10H2220/151 ,  G10H2220/161 ,  G10H2220/201 ,  G10H2240/075 ,  G10H2240/175

Abstract: Advanced, but user-friendly composition and editing environments for musical scores may be provided using the types, and in some cases the instances, of computing devices that will in turn consume musical score content so generated. Indeed, by integrating musical composition facilities within synthetic musical instruments that can be widely deployed on hand-held or portable computing devices, a social music network that includes such synthetic musical instruments gains access to a large, and potentially prolific, population of authors, editors and reviewers, as well as to the community-sourced musical scores that they can generate. By curating such content and/or by applying crowd-sourcing or other computational techniques to maintain quality, a social music network may rapidly deploy the new and ever evolving content that its user community desires.

公开(公告)号：USD806092S1

公开(公告)日：2017-12-26

申请号：US29566242

申请日：2016-05-27

Applicant: Smule, Inc.

Designer： Benjamin Hersh ,  John Shimmin ,  Jeannie Yang ,  Perry R. Cook

公开(公告)号：USD805529S1

公开(公告)日：2017-12-19

申请号：US29566249

申请日：2016-05-27

Applicant: Smule, Inc.

Designer： Benjamin Hersh ,  John Shimmin ,  Jeannie Yang ,  Perry R. Cook

公开(公告)号：US20170337927A1

公开(公告)日：2017-11-23

申请号：US15606111

申请日：2017-05-26

Applicant: SMULE, INC.

Inventor： Parag Chordia ,  Mark Godfrey ,  Alexander Rae ,  Prerna Gupta ,  Perry R. Cook

IPC: G10L19/02 ,  G10L21/055 ,  G10H1/36 ,  G10L19/00

CPC classification number: G10L19/02 ,  G10H1/366 ,  G10H2210/051 ,  G10H2240/141 ,  G10H2250/235 ,  G10L19/00 ,  G10L21/055

Abstract: Captured vocals may be automatically transformed using advanced digital signal processing techniques that provide captivating applications, and even purpose-built devices, in which mere novice user-musicians may generate, audibly render and share musical performances. In some cases, the automated transformations allow spoken vocals to be segmented, arranged, temporally aligned with a target rhythm, meter or accompanying backing tracks and pitch corrected in accord with a score or note sequence. Speech-to-song music applications are one such example. In some cases, spoken vocals may be transformed in accord with musical genres such as rap using automated segmentation and temporal alignment techniques, often without pitch correction. Such applications, which may employ different signal processing and different automated transformations, may nonetheless be understood as speech-to-rap variations on the theme.

公开(公告)号：USD801999S1

公开(公告)日：2017-11-07

申请号：US29566079

申请日：2016-05-26

Applicant: Smule, Inc.

Designer： Benjamin Hersh ,  John Shimmin ,  Jeannie Yang ,  Perry R. Cook

公开(公告)号：US09596036B2

公开(公告)日：2017-03-14

申请号：US14752283

申请日：2015-06-26

Applicant: Smule, Inc.

Inventor： Perry R. Cook

IPC: H04B7/00 ,  H04B11/00 ,  G06F3/16 ,  H04M1/725 ,  H04W76/02 ,  G10L19/018

CPC classification number: H04B11/00 ,  G06F3/16 ,  G10L19/018 ,  H04M1/72527 ,  H04M1/7253 ,  H04W76/14

Abstract: Techniques have been developed for transmitting and receiving information conveyed through the air from one portable device to another as a generally unperceivable coding within an otherwise recognizable acoustic signal. For example, in some embodiments in accordance with the present invention(s), information is acoustically communicated from a first handheld device toward a second by encoding the information in a signal that, when converted into acoustic energy at an acoustic transducer of the first handheld device, is characterized in that the acoustic energy is discernable to a human ear yet the encoding of the information therein is generally not perceivable by the human. The acoustic energy is transmitted from the acoustic transducer of the first handheld device toward the second handheld device across an air gap that constitutes a substantially entirety of the distance between the devices. Acoustic energy received at the second handheld device may then be processed using signal processing techniques tailored to detection of the particular information encodings employed.

Abstract translation: 已经开发了用于将通过空气传送的信息从一个便携式设备发送到另一个的技术，作为在另外可识别的声学信号中的通常不可理解的编码。 例如，在根据本发明的一些实施例中，通过对信号进行编码来将信息从第一手持设备传播到第二手持设备，当信号被转换成第一手持设备的声换能器时的声能时 装置的特征在于，声能量可以被人耳识别，但是其中的信息的编码通常不被人感知。 声能从第一手持装置的声换能器朝向第二手持装置穿过构成装置之间基本上整个距离的气隙传送。 然后可以使用针对所采用的特定信息编码进行定制的信号处理技术来处理在第二手持设备处接收的声能。

公开(公告)号：US20160358595A1

公开(公告)日：2016-12-08

申请号：US15173041

申请日：2016-06-03

Applicant: SMULE, INC.

Inventor： Kevin Sung ,  Bona Kim ,  Jon Moldover ,  John Shimmin ,  Jeannie Yang ,  Perry R. Cook

IPC: G10H1/36 ,  G11B27/02

CPC classification number: G10H1/368 ,  G10H1/366 ,  G10H2210/331 ,  G10H2220/005 ,  G10H2220/011 ,  G10H2220/355 ,  G10H2230/015 ,  G10H2240/175 ,  G10H2240/251 ,  G11B27/02

Abstract: Vocal audio of a user together with performance synchronized video is captured and coordinated with audiovisual contributions of other users to form composite duet-style or glee club-style or window-paned music video-style audiovisual performances. In some cases, the vocal performances of individual users are captured (together with performance synchronized video) on mobile devices, television-type display and/or set-top box equipment in the context of karaoke-style presentations of lyrics in correspondence with audible renderings of a backing track. Contributions of multiple vocalists are coordinated and mixed in a manner that selects for presentation, at any given time along a given performance timeline, performance synchronized video of one or more of the contributors. Selections are in accord with a visual progression that codes a sequence of visual layouts in correspondence with other coded aspects of a performance score such as pitch tracks, backing audio, lyrics, sections and/or vocal parts.

Abstract translation: 用户的声音与表演同步视频一起被捕获并与其他用户的视听贡献协调，以形成复合二重风格或欢乐的俱乐部风格或窗口播放的音乐视频风格的视听表演。 在某些情况下，在与声音效果对应的歌词卡拉OK式演示的背景下，在移动设备，电视机型显示器和/或机顶盒设备上捕获个人用户的声乐表演（以及性能同步视频） 的背景轨道。 协调和混合多个歌手的贡献，以选择演示，在给定的演奏时间表的任何给定时间，一个或多个贡献者的演出同步视频。 选择符合视觉进程，其编码与表演评分的其他编码方面对应的视觉布局序列，例如音高轨迹，背景音频，歌词，部分和/或声部。

公开(公告)号：US20160057316A1

公开(公告)日：2016-02-25

申请号：US14928727

申请日：2015-10-30

Applicant: Smule, Inc.

Inventor： Mark T. Godfrey ,  Perry R. Cook

IPC: H04N5/04 ,  G10L13/033 ,  G10H1/36 ,  G10L21/013

CPC classification number: H04N5/04 ,  G10H1/366 ,  G10H2210/066 ,  G10H2210/331 ,  G10H2240/251 ,  G10L13/0335 ,  G10L21/013 ,  Y10S84/04

Abstract: Audiovisual performances, including vocal music, are captured and coordinated with those of other users in ways that create compelling user experiences. In some cases, the vocal performances of individual users are captured (together with performance synchronized video) on mobile devices, television-type display and/or set-top box equipment in the context of karaoke-style presentations of lyrics in correspondence with audible renderings of a backing track. Contributions of multiple vocalists are coordinated and mixed in a manner that selects for visually prominent presentation performance synchronized video of one or more of the contributors. Prominence of particular performance synchronized video may be based, at least in part, on computationally-defined audio features extracted from (or computed over) captured vocal audio. Over the course of a coordinated audiovisual performance timeline, these computationally-defined audio features are selective for performance synchronized video of one or more of the contributing vocalists.

Abstract translation: 包括声乐在内的视听表演，以其他用户的方式被捕获和协调，以创造令人信服的用户体验。 在某些情况下，在与声音效果对应的歌词卡拉OK式演示的背景下，在移动设备，电视机型显示器和/或机顶盒设备上捕获个人用户的声乐表演（以及性能同步视频） 的背景轨道。 多个歌手的贡献以协调和混合的方式，为视觉上突出的演示效果选择一个或多个贡献者的同步视频。 特定性能同步视频的突出可以至少部分地基于从（或计算的）捕获的声音提取的计算定义的音频特征。 在协调的视听表演时间表的过程中，这些计算定义的音频特征对于一个或多个贡献歌手的性能同步视频是有选择性的。