公开(公告)号：GB2553351A

公开(公告)日：2018-03-07

申请号：GB201615006

申请日：2016-09-05

Applicant: NOKIA TECHNOLOGIES OY

Inventor： JUKKA SAARINEN ,  FRANCESCO CRICRI

IPC: G06T19/20 ,  G06K9/46

Abstract: A method and apparatus configured to identify a plurality of objects 2.1 in a captured video and/or audio scene, process the scene by removing an object 2.2 from the scene; measuring the effect of removing said object using received data 2.3; reintroducing said object into the scene 2.5; and repeating the said steps for one or more other objects in the scene in turn 2.6. The saliency level is then determined for each object based on the measured effect 2.8. The effect may be measured by the interactions of the remaining objects and the received data may be from sensors of an external observer, possibly using a VR headset.

公开(公告)号：GB2551702A

公开(公告)日：2018-01-03

申请号：GB201610802

申请日：2016-06-21

Applicant: NOKIA TECHNOLOGIES OY

Inventor： FRANCESCO CRICRI ,  JUKKA SAARINEN

IPC: H04S7/00 ,  G01S3/801 ,  G06T7/00 ,  H04R3/00

Abstract: A spatial audio capture system 1 involves determining whether an estimated position of an audio capture device 12, such as a lavalier microphone attached to a performer 26 on stage, is within boundaries 14 of a predetermined area. If the estimated position is not within the boundaries of the predetermined area, audio data captured by the audio capture device is associated with an adjusted position. The adjusted position may be located at the centre, at a boundary, or at a last estimated position of the predetermined area. The position estimation may be achieved based on a location of a positioning tag 18, while the adjusted position may be based on a visually detected position of a body associated with the audio capture device (e.g. using a video camera). The captured audio data may be rendered by a spatial audio playback device from a location corresponding to the adjusted position. The boundaries of the predetermined area may be set by using a gesture recognition device to detect one or more gestures of a user, such as an actor, speaker or performer, associated with the audio capture device. The system may be utilised in the production of virtual reality videos.