公开(公告)号：US11343630B2

公开(公告)日：2022-05-24

申请号：US17197047

申请日：2021-03-10

Applicant: WILUS INSTITUTE OF STANDARDS AND TECHNOLOGY INC.

Inventor： Hyunoh Oh ,  Taegyu Lee ,  Jinsam Kwak ,  Juhyung Son

IPC: H04S3/00 ,  G10L19/20

Abstract: The present invention relates to a method and an apparatus for processing an audio signal, and more particularly, to a method and an apparatus for processing an audio signal, which synthesize an object signal and a channel signal and effectively perform binaural rendering of the synthesized signal.
To this end, provided are a method for processing an audio signal, which includes: receiving an input audio signal including a multi-channel signal; receiving truncated subband filter coefficients for filtering the input audio signal, the truncated subband filter coefficients being at least some of subband filter coefficients obtained from binaural room impulse response (BRIR) filter coefficients for binaural filtering of the input audio signal and the length of the truncated subband filter coefficients being determined based on filter order information obtained by at least partially using reverberation time information extracted from the corresponding subband filter coefficients; obtaining vector information indicating the BRIR filter coefficients corresponding to each channel of the input audio signal; and filtering each subband signal of the multi-channel signal by using the truncated subband filter coefficients corresponding to the relevant channel and subband based on the vector information and an apparatus for processing an audio signal by using the same.

公开(公告)号：US11109180B2

公开(公告)日：2021-08-31

申请号：US16864127

申请日：2020-04-30

Applicant: WILUS INSTITUTE OF STANDARDS AND TECHNOLOGY INC.

Inventor： Taegyu Lee ,  Hyunoh Oh

IPC: H04S7/00 ,  G10L19/008 ,  H04S3/00 ,  G10L19/02

Abstract: The present invention relates to a method for generating a filter for an audio signal and a parameterization device for the same, and more particularly, to a method for generating a filter for an audio signal, to implement filtering of an input audio signal with a low computational complexity, and a parameterization device therefor.
To this end, provided are a method for generating a filter for an audio signal, including: receiving at least one binaural room impulse response (BRIR) filter coefficients for binaural filtering of an input audio signal; converting the BRIR filter coefficients into a plurality of subband filter coefficients; obtaining average reverberation time information of a corresponding subband by using reverberation time information extracted from the subband filter coefficients; obtaining at least one coefficient for curve fitting of the obtained average reverberation time information; obtaining flag information indicating whether the length of the BRIR filter coefficients in a time domain is more than a predetermined value; obtaining filter order information for determining a truncation length of the subband filter coefficients, the filter order information being obtained by using the average reverberation time information or the at least one coefficient according to the obtained flag information and the filter order information of at least one subband being different from filter order information of another subband; and truncating the subband filter coefficient by using the obtained filter order information and a parameterization device therefor.

公开(公告)号：US10771910B2

公开(公告)日：2020-09-08

申请号：US16395242

申请日：2019-04-26

Applicant: WILUS INSTITUTE OF STANDARDS AND TECHNOLOGY INC.

Inventor： Hyunoh Oh ,  Taegyu Lee ,  Jinsam Kwak ,  Juhyung Son

IPC: H04S3/00 ,  G10L19/20

Abstract: The present invention relates to a method and an apparatus for processing an audio signal, and more particularly, to a method and an apparatus for processing an audio signal, which synthesize an object signal and a channel signal and effectively perform binaural rendering of the synthesized signal.To this end, provided are a method for processing an audio signal, which includes: receiving an input audio signal including a multi-channel signal; receiving truncated subband filter coefficients for filtering the input audio signal, the truncated subband filter coefficients being at least some of subband filter coefficients obtained from binaural room impulse response (BRIR) filter coefficients for binaural filtering of the input audio signal and the length of the truncated subband filter coefficients being determined based on filter order information obtained by at least partially using reverberation time information extracted from the corresponding subband filter coefficients; obtaining vector information indicating the BRIR filter coefficients corresponding to each channel of the input audio signal; and filtering each subband signal of the multi-channel signal by using the truncated subband filter coefficients corresponding to the relevant channel and subband based on the vector information and an apparatus for processing an audio signal by using the same.

公开(公告)号：US09848275B2

公开(公告)日：2017-12-19

申请号：US15300273

申请日：2015-04-02

Applicant: WILUS INSTITUTE OF STANDARDS AND TECHNOLOGY INC.

Inventor： Taegyu Lee ,  Hyun Oh Oh

IPC: H04S7/00 ,  H04S3/00

CPC classification number: H04S7/307 ,  G10L19/008 ,  H04R3/04 ,  H04R2430/03 ,  H04R2499/11 ,  H04R2499/15 ,  H04S3/008 ,  H04S7/303 ,  H04S7/306 ,  H04S2400/01 ,  H04S2400/03 ,  H04S2400/11 ,  H04S2420/01 ,  H04S2420/07

Abstract: The present invention relates to a method and an apparatus for processing an audio signal, and more particularly, to a method and an apparatus for processing an audio signal, which synthesizes an object signal and a channel signal and effectively binaural-render the synthesized signal.To this end, the present invention provides a method for processing an audio signal, including: receiving an input audio signal including at least one of a multi-channel signal and a multi-object signal; receiving type information of a filter set for binaural filtering of the input audio signal, the type of the filter set being one of a finite impulse response (FIR) filter, a parameterized filter in a frequency domain, and a parameterized filter in a time domain; receiving filter information for binaural filtering based on the type information; and performing the binaural filtering for the input audio signal by using the received filter information, wherein when the type information indicates the parameterized filter in the frequency domain, in the receiving of the filter information, a subband filter coefficient having a length determined for each subband of a frequency domain is received, and in the performing of the binaural filtering, each subband signal of the input audio signal is filtered by using the subband filter coefficient corresponding thereto and an apparatus for processing an audio signal by using the same.

公开(公告)号：US11195537B2

公开(公告)日：2021-12-07

申请号：US16747533

申请日：2020-01-21

Applicant: INDUSTRY-ACADEMIC COOPERATION FOUNDATION, YONSEI UNIVERSITY ,  WILUS INSTITUTE OF STANDARDS AND TECHNOLOGY INC. ,  ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE

Inventor： Taegyu Lee ,  Hyunoh Oh ,  Youngcheol Park ,  Daehee Youn ,  Jeongil Seo ,  Yongju Lee ,  Seungkwon Beack ,  Kyeongok Kang ,  Daeyoung Jang

IPC: G10L19/008 ,  H04S3/00 ,  H04R5/033 ,  H04R3/00

Abstract: The present invention relates to a method and an apparatus for binaural rendering an audio signal using variable order filtering in frequency domain. To this end, provided are a method for processing an audio signal including: receiving an input audio signal; receiving a set of truncated subband filter coefficients for filtering each subband signal of the input audio signal, the set of truncated subband filter coefficients being constituted by one or more FFT filter coefficients generated by performing FFT by a predetermined block size; generating at least one subframe for each subband; generating at least one filtered subframe for each subband; performing inverse FFT on the filtered subframe for each subband; and generating a filtered subband signal by overlap-adding the transformed subframe for each subband and an apparatus for processing an audio signal using the same.

公开(公告)号：US10701511B2

公开(公告)日：2020-06-30

申请号：US16544832

申请日：2019-08-19

Applicant: WILUS INSTITUTE OF STANDARDS AND TECHNOLOGY INC.

Inventor： Taegyu Lee ,  Hyunoh Oh

IPC: H04S7/00 ,  G10L19/008 ,  H04S3/00 ,  G10L19/02

Abstract: The present invention relates to a method for generating a filter for an audio signal and a parameterization device for the same, and more particularly, to a method for generating a filter for an audio signal, to implement filtering of an input audio signal with a low computational complexity, and a parameterization device therefor.To this end, provided are a method for generating a filter for an audio signal, including: receiving at least one binaural room impulse response (BRIR) filter coefficients for binaural filtering of an input audio signal; converting the BRIR filter coefficients into a plurality of subband filter coefficients; obtaining average reverberation time information of a corresponding subband by using reverberation time information extracted from the subband filter coefficients; obtaining at least one coefficient for curve fitting of the obtained average reverberation time information; obtaining flag information indicating whether the length of the BRIR filter coefficients in a time domain is more than a predetermined value; obtaining filter order information for determining a truncation length of the subband filter coefficients, the filter order information being obtained by using the average reverberation time information or the at least one coefficient according to the obtained flag information and the filter order information of at least one subband being different from filter order information of another subband; and truncating the subband filter coefficient by using the obtained filter order information and a parameterization device therefor.

公开(公告)号：US20190253822A1

公开(公告)日：2019-08-15

申请号：US16395242

申请日：2019-04-26

Applicant: WILUS INSTITUTE OF STANDARDS AND TECHNOLOGY INC.

Inventor： Hyunoh OH ,  Taegyu Lee ,  Jinsam Kwak ,  Juhyung Son

IPC: H04S3/00 ,  G10L19/20

CPC classification number: H04S3/008 ,  G10L19/20 ,  H04S2400/01 ,  H04S2400/03 ,  H04S2400/11 ,  H04S2420/01 ,  H04S2420/07

Abstract: The present invention relates to a method and an apparatus for processing an audio signal, and more particularly, to a method and an apparatus for processing an audio signal, which synthesize an object signal and a channel signal and effectively perform binaural rendering of the synthesized signal.To this end, provided are a method for processing an audio signal, which includes: receiving an input audio signal including a multi-channel signal; receiving truncated subband filter coefficients for filtering the input audio signal, the truncated subband filter coefficients being at least some of subband filter coefficients obtained from binaural room impulse response (BRIR) filter coefficients for binaural filtering of the input audio signal and the length of the truncated subband filter coefficients being determined based on filter order information obtained by at least partially using reverberation time information extracted from the corresponding subband filter coefficients; obtaining vector information indicating the BRIR filter coefficients corresponding to each channel of the input audio signal; and filtering each subband signal of the multi-channel signal by using the truncated subband filter coefficients corresponding to the relevant channel and subband based on the vector information and an apparatus for processing an audio signal by using the same.

公开(公告)号：US09860668B2

公开(公告)日：2018-01-02

申请号：US15300277

申请日：2015-04-02

Applicant: WILUS INSTITUTE OF STANDARDS AND TECHNOLOGY INC. ,  ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE

Inventor： Hyun Oh Oh ,  Taegyu Lee ,  Jeongil Seo

IPC: H04S3/00 ,  H04S7/00

CPC classification number: H04S7/307 ,  G10L19/008 ,  H04R3/04 ,  H04R2430/03 ,  H04R2499/11 ,  H04R2499/15 ,  H04S3/008 ,  H04S7/303 ,  H04S7/306 ,  H04S2400/01 ,  H04S2400/03 ,  H04S2400/11 ,  H04S2420/01 ,  H04S2420/07

Abstract: The present invention relates to a method and an apparatus for processing an audio signal, and more particularly, to a method and an apparatus for processing an audio signal, which synthesizes an object signal and a channel signal and effectively binaural-render the synthesized signal.To this end, the present invention provides a method for processing an audio signal, including: receiving an input audio signal including a multi-channel signal; receiving filter order information variably determined for each subband of a frequency domain; receiving block length information for each subband based on a fast Fourier transform length for each subband of filter coefficients for binaural filtering of the input audio signal; receiving Variable Order Filtering in Frequency-domain (VOFF) coefficients corresponding to each subband and each channel of the input audio signal per block of the corresponding subband, a total sum of lengths of the VOFF coefficients corresponding to the same subband and the same channel being determined based on the filter order information of the corresponding subband; and filtering each subband signal of the input audio signal by using the received VOFF coefficients to generate a binaural output signal and an apparatus for processing an audio signal by using the same.

公开(公告)号：US10580417B2

公开(公告)日：2020-03-03

申请号：US15031275

申请日：2014-10-22

Applicant: INDUSTRY-ACADEMIC COOPERATION FOUNDATION, YONSEI UNIVERSITY ,  WILUS INSTITUTE OF STANDARDS AND TECHNOLOGY INC. ,  ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE

Inventor： Taegyu Lee ,  Hyunoh Oh ,  Youngcheol Park ,  Daehee Youn ,  Jeongil Seo ,  Yongju Lee ,  Seungkwon Beack ,  Kyeongok Kang ,  Daeyoung Jang

IPC: G10L19/008 ,  H04S3/00 ,  H04R5/033 ,  H04R3/00

Abstract: The present invention relates to a method and an apparatus for binaural rendering an audio signal using variable order filtering in frequency domain. To this end, provided are a method for processing an audio signal including: receiving an input audio signal; receiving a set of truncated subband filter coefficients for filtering each subband signal of the input audio signal, the set of truncated subband filter coefficients being constituted by one or more FFT filter coefficients generated by performing FFT by a predetermined block size; generating at least one subframe for each subband; generating at least one filtered subframe for each subband; performing inverse FFT on the filtered subframe for each subband; and generating a filtered subband signal by overlap-adding the transformed subframe for each subband and an apparatus for processing an audio signal using the same.

公开(公告)号：US10469978B2

公开(公告)日：2019-11-05

申请号：US16159624

申请日：2018-10-13

Applicant: WILUS INSTITUTE OF STANDARDS AND TECHNOLOGY INC.

Inventor： Taegyu Lee ,  Hyun Oh Oh

IPC: H04S7/00 ,  H04S3/00 ,  H04R3/04 ,  G10L19/008

Abstract: The present invention relates to a method and an apparatus for processing an audio signal, and more particularly, to a method and an apparatus for processing an audio signal, which synthesizes an object signal and a channel signal and effectively binaural-render the synthesized signal.To this end, the present invention provides a method for processing an audio signal, including: receiving an input audio signal including at least one of a multi-channel signal and a multi-object signal; receiving type information of a filter set for binaural filtering of the input audio signal, the type of the filter set being one of a finite impulse response (FIR) filter, a parameterized filter in a frequency domain, and a parameterized filter in a time domain; receiving filter information for binaural filtering based on the type information; and performing the binaural filtering for the input audio signal by using the received filter information, wherein when the type information indicates the parameterized filter in the frequency domain, in the receiving of the filter information, a subband filter coefficient having a length determined for each subband of a frequency domain is received, and in the performing of the binaural filtering, each subband signal of the input audio signal is filtered by using the subband filter coefficient corresponding thereto and an apparatus for processing an audio signal by using the same.