Audio Engineering Society. Convention Paper

Similar documents
Perceptually-Based Joint-Program Audio Coding

Parametric Coding of Spatial Audio

Audio-coding standards

New Results in Low Bit Rate Speech Coding and Bandwidth Extension

Audio-coding standards

Appendix 4. Audio coding algorithms

ELL 788 Computational Perception & Cognition July November 2015

EE482: Digital Signal Processing Applications

Efficiënte audiocompressie gebaseerd op de perceptieve codering van ruimtelijk geluid

Efficient Representation of Sound Images: Recent Developments in Parametric Coding of Spatial Audio

AUDIO COMPRESSION ATLO W BIT RATES USING A SIGNAL ADAPTIVE SWITCHED FILTERBANK. AT&T Bell Labs. Murray Hill, NJ 07974

Perceptually motivated Sub-band Decomposition for FDLP Audio Coding

Improved Audio Coding Using a Psychoacoustic Model Based on a Cochlear Filter Bank

A PSYCHOACOUSTIC MODEL WITH PARTIAL SPECTRAL FLATNESS MEASURE FOR TONALITY ESTIMATION

Zhitao Lu and William A. Pearlman. Rensselaer Polytechnic Institute. Abstract

Mpeg 1 layer 3 (mp3) general overview

Proceedings of Meetings on Acoustics

Module 9 AUDIO CODING. Version 2 ECE IIT, Kharagpur

Scalable Perceptual and Lossless Audio Coding based on MPEG-4 AAC

2.4 Audio Compression

An investigation of non-uniform bandwidths auditory filterbank in audio coding

Efficient Signal Adaptive Perceptual Audio Coding

Perceptual Coding. Lossless vs. lossy compression Perceptual models Selecting info to eliminate Quantization and entropy encoding

MUSIC A Darker Phonetic Audio Coder

Both LPC and CELP are used primarily for telephony applications and hence the compression of a speech signal.

Principles of Audio Coding

The MPEG-4 General Audio Coder

Contents. 3 Vector Quantization The VQ Advantage Formulation Optimality Conditions... 48

The Reference Model Architecture for MPEG Spatial Audio Coding

Perceptual coding. A psychoacoustic model is used to identify those signals that are influenced by both these effects.

Chapter 14 MPEG Audio Compression

AUDIOVISUAL COMMUNICATION

Parametric Coding of High-Quality Audio

Audio Engineering Society. Convention Paper. Presented at the 116th Convention 2004 May 8 11 Berlin, Germany

Audio Compression. Audio Compression. Absolute Threshold. CD quality audio:

Audio Coding and MP3

Optical Storage Technology. MPEG Data Compression

MPEG-4 General Audio Coding

Convention Paper 5660

Audio Compression Using Decibel chirp Wavelet in Psycho- Acoustic Model

Low Bitrate Coding of Spot Audio Signals for Interactive and Immersive Audio Applications

SPREAD SPECTRUM AUDIO WATERMARKING SCHEME BASED ON PSYCHOACOUSTIC MODEL

Filterbanks and transforms

MPEG-4 aacplus - Audio coding for today s digital media world

Audio Engineering Society. Convention Paper. Presented at the 123rd Convention 2007 October 5 8 New York, NY, USA

19 th INTERNATIONAL CONGRESS ON ACOUSTICS MADRID, 2-7 SEPTEMBER 2007

DRA AUDIO CODING STANDARD

Introducing Audio Signal Processing & Audio Coding. Dr Michael Mason Snr Staff Eng., Team Lead (Applied Research) Dolby Australia Pty Ltd

AUDIOVISUAL COMMUNICATION

Perceptual Audio Coders What to listen for: Artifacts of Parametric Coding

JPEG IMAGE CODING WITH ADAPTIVE QUANTIZATION

MPEG-1. Overview of MPEG-1 1 Standard. Introduction to perceptual and entropy codings

DSP. Presented to the IEEE Central Texas Consultants Network by Sergio Liberman

THE PERCEPTUAL AUDIO CODER (PAC) Deepen Sinha 1. Sean Dorward 1. (1)Lucent Technologies Bell Laboratories and (2)AT&T Research Labs

HAVE YOUR CAKE AND HEAR IT TOO: A HUFFMAN CODED, BLOCK SWITCHING, STEREO PERCEPTUAL AUDIO CODER

Audio Engineering Society. Convention Paper. Presented at the 126th Convention 2009 May 7 10 Munich, Germany

Distributed Signal Processing for Binaural Hearing Aids

5: Music Compression. Music Coding. Mark Handley

( ) ; For N=1: g 1. g n

Multimedia Communications. Audio coding

Introducing Audio Signal Processing & Audio Coding. Dr Michael Mason Senior Manager, CE Technology Dolby Australia Pty Ltd

Spectral modeling of musical sounds

Fundamentals of Perceptual Audio Encoding. Craig Lewiston HST.723 Lab II 3/23/06

Lecture 16 Perceptual Audio Coding

Speech and audio coding

/ / _ / _ / _ / / / / /_/ _/_/ _/_/ _/_/ _\ / All-American-Advanced-Audio-Codec

25*$1,6$7,21,17(51$7,21$/('(1250$/,6$7,21,62,(&-7&6&:* &2',1*2)029,1*3,&785(6$1'$8',2 &DOOIRU3URSRVDOVIRU1HZ7RROVIRU$XGLR&RGLQJ

Convention Paper 6202 Presented at the 117th Convention 2004 October San Francisco, CA, USA

Convention Paper Presented at the 121st Convention 2006 October 5 8 San Francisco, CA, USA

MPEG-4 Audio Lossless Coding

An adaptive wavelet-based approach for perceptual low bit rate audio coding attending to entropy-type criteria

Motion Estimation. Original. enhancement layers. Motion Compensation. Baselayer. Scan-Specific Entropy Coding. Prediction Error.

JND-based spatial parameter quantization of multichannel audio signals

Compressed Audio Demystified by Hendrik Gideonse and Connor Smith. All Rights Reserved.

Very Low Bit Rate Color Video

Perceptual Audio Coding Using Adaptive Preand Post-Filters and Lossless Compression

Simple Watermark for Stereo Audio Signals with Modulated High-Frequency Band Delay

SAOC and USAC. Spatial Audio Object Coding / Unified Speech and Audio Coding. Lecture Audio Coding WS 2013/14. Dr.-Ing.

14th European Signal Processing Conference (EUSIPCO 2006), Florence, Italy, September 4-8, 2006, copyright by EURASIP

Efficient Implementation of Transform Based Audio Coders using SIMD Paradigm and Multifunction Computations

Rate Distortion Optimization in Video Compression

Audio coding for digital broadcasting

The following bit rates are recommended for broadcast contribution employing the most commonly used audio coding schemes:

Surrounded by High-Definition Sound

ISO/IEC INTERNATIONAL STANDARD. Information technology MPEG audio technologies Part 3: Unified speech and audio coding

Room Acoustics. CMSC 828D / Spring 2006 Lecture 20

MOBILE VIDEO COMMUNICATIONS IN WIRELESS ENVIRONMENTS. Jozsef Vass Shelley Zhuang Jia Yao Xinhua Zhuang. University of Missouri-Columbia

ijdsp Interactive Illustrations of Speech/Audio Processing Concepts

Using Noise Substitution for Backwards-Compatible Audio Codec Improvement

Principles of MPEG audio compression

Context based optimal shape coding

Modeling of an MPEG Audio Layer-3 Encoder in Ptolemy

Adaptive Quantization for Video Compression in Frequency Domain

Data Compression. Audio compression

APPLYING EXTRAPOLATION AND INTERPOLATION METHODS TO MEASURED AND SIMULATED HRTF DATA USING SPHERICAL HARMONIC DECOMPOSITION.

signal-to-noise ratio (PSNR), 2

1 Audio quality determination based on perceptual measurement techniques 1 John G. Beerends

PQMF Filter Bank, MPEG-1 / MPEG-2 BC Audio. Fraunhofer IDMT

Blind Measurement of Blocking Artifact in Images

Key words: B- Spline filters, filter banks, sub band coding, Pre processing, Image Averaging IJSER

Transcription:

Audio Engineering Society onvention Paper Presented at the th onvention 00 May 0{ Munich, Germany This convention paper has been reproduced from the author's advance manuscript, without editing, corrections, or consideration by the Review Board. The AES takes no responsibility for the contents. Additional papers may be obtained by sending request and remittance to Audio Engineering Society, 60 East 4nd Street, New York, New York 065-50, USA also see www.aes.org. All rights reserved. Reproduction of this paper, or any portion thereof, is not permitted without direct permission from the Journal of the Audio Engineering Society. Binaural ue oding Applied to Stereo and Multi-hannel Audio ompression hristof Faller,Frank Baumgarte Agere Systems, Media Signal Processing Research, Murray Hill, New Jersey 07974, USA orrespondence should be addressed to hristof Faller (cfaller@volny.cz) ABSTRAT Binaural ue oding (B) is an ecient representation for spatial audio that can be applied to stereo and multichannel audio compression. onventional mono audio coders are enhanced with B for coding of stereo and multichannel audio signals. There is only a relatively small overhead in bitrate for encoding stereo and multi-channel audio signals compared to the bitrate of the mono audio coder alone. The presented implementations have low complexity and are suitable for real-time applications. Results from subjective tests suggest that the proposed scheme provides better audio quality for encoding of stereo audio signals than conventional perceptual transform audio coders for a wide range of bitrates. INTRODUTION Recently the concept of Binaural ue oding (B) was introduced []. As shown in Fig., a B encoder (type II in []) converts a multi-channel audio signal into a mono audio signal plus a low bitrate B bitstream. A corresponding B decoder is shown in Fig.. It generates a multi-channel audio signal given the mono audio signal and the B bitstream. The aim is that the synthesized multi-channel audio signal is perceptually similar to the original multi-channel signal. Obviously, such a scheme can be applied to audio compression. In this paper, we show how conventional mono audio coders can be enhanced with B for coding of stereo and multichannel audio signals. There is only little overhead compared to the bitrate of the mono audio coder alone.

... FALLER AND BAUMGARTE IN Σ... B ENODER B Fig. : B encoder with multi-channel audio input. B B DEODER OUT Fig. : A B decoder with multi-channel audio output. The most obvious way for coding of stereo and multichannel audio signals is to apply a mono audio coder independently to each channel. However, then the bitrate scales linearly with the number of channels. Also, the signal and the quantization noise are in many cases perceptually not located at the same direction. Therefore, the binaural masking level dierence (BMLD) [] needs to be considered. BMLD results in less masking of quantization noise so that the bitrate increases. Perceptual audio coders such as MPEG- AA [4] and PA [5] commonly apply two joint channel coding techniques for reducing the bitrate: () Sum/Dierence (S/D) coding [6] is used to reduce the redundancy between pairs of channels (e.g. left and right). With S/D coding the sum and dierence of left and right are encoded instead of the left and right signals. Given the decoded sum and dierence signals, the decoder can recover the left and right signals. Most audio coders decide adaptively in time, for each frequency band independently, whether to use S/D coding or not. S/D coding is used whenever it requires less bits than encoding left and right independently. () Intensity Stereo [7] as used in MPEG- AA [4] transmits for each coding band of the high frequencies only the sum signal along with a scalar representing the energy distribution among channels. The time-frequency resolution of intensity stereo is the same as for the audio coder's coding bands. Therefore, the time-frequency resolution for intensity stereo is not optimized for spatial perception [8]. Additionally, the lterbanks used in audio coders are critically sampled and spectral modications that are carried out for intensity stereo can lead to aliasing artifacts [8]. Because of these limitations, intensity stereo is mostly suitable for non-transparent audio coding and is applied mainly at high frequencies. Even when both of these techniques are applied, the bitrate for coding of stereo and multichannel audio signals is still signicantly higher than the IN Σ... ENODER B ENODER OMBINER B OMBINED Fig. : Aconventional mono audio encoder is enhanced to a multi-channel audio encoder with B. bitrate for encoding a mono audio signal. The presented scheme based on B is able to encode such signals at a total bitrate close to the bitrate for encoding mono audio signals. In Section it is described how conventional mono audio coders are enhanced with a B encoder and B decoder for coding of stereo and multi-channel audio signals. Section describes the implementation of the B encoder that is used for the proposed audio compression scheme. The corresponding B decoder is described in Section 4. Results from several subjective tests comparing conventional audio coders with B enhanced coders are presented in Section 5. onclusions are drawn in Section 6. BINAURAL UE ODING FOR OMPRESSION onventional mono audio coders can be enhanced with B for encoding stereo or multi-channel audio signals. A B enhanced mono audio encoder is shown in Fig.. The sum signal of all input channels is encoded with the mono audio encoder resulting in an audio bitstream. Many stereo or multi-channel audio signals are mono compatible, i.e. summation of the channels results in a high quality mono audio signal. The B encoder analyzes the multi-channel input signal and generates a B bitstream. The bitstream combiner merges both bitstreams to one combined bitstream. Similarly, the mono audio decoder is enhanced with B as shown in Fig. 4. The combined bitstream is separated resulting in the audio bitstream and B bitstream. The mono audio decoder decodes the audio bitstream. The resulting mono audio signal and the B bitstream are the inputs of the B decoder which generates an output multi-channel audio signal aiming to be perceptually the same as the original multi-channel signal. B ENODER IMPLEMENTATION The scheme of the B encoder that is used is shown in Fig. 5. First, the audio input channels are converted to a spectral domain with a DFT-based transform with overlapping windows ( transform in Fig. 5). AES TH ONVENTION, MUNIH, GERMANY, 00 MAY 0{

... FALLER AND BAUMGARTE OMBINED DEODER SEPARATION B DEODER B OUT Fig. 4: A conventional mono audio decoder is enhanced to a multi-channel audio decoder with B. IN... ILD ESTIMATION QUANTIZATION AND ODING ITD ESTIMATION B Fig. 5: Implementation of the B encoder for a ;channel audio signal. The resulting uniform spectrum is divided into B nonoverlapping partitions with index b. Each partition has a bandwidth proportional to the Equivalent Rectangular Bandwidth (ERB) [9]. The inter-channel level dierences (ILD) and inter-channel time dierences (ITD) are estimated for each partition for each frame k. The ILD and ITD are quantized and coded resulting in the B bitstream. The following sections describe the scheme of Fig. 5 in detail.. The Time-Frequency Transform The same time-frequency transform is used for the B encoder and B decoder. In order to generate several audio channels in the B decoder, with specic ILD and ITD between pairs of channels, we need to be able to modify the level of audio signals and introduce delays adaptively in frequency and time. Therefore, the goal is to have a spectral domain in which it is possible to apply level modications, positive and negative time-shifts, or more generally speaking, ltering in a time-varying fashion, to the underlying audio signal. We will now show how a DFT can meet these requirements. A DFT is used on a frame basis. The time index k is the frame number that enumerates the applied DFT transforms in time. The implementation of positive and negative time-shifts is described in the following. When W samples s 0, :::, s W; are transformed by adftto a complex spectral domain, S n (0 n<w), a circular time shift of d time-domain samples is obtained by modifying the W spectral values by ^Sn = S n exp(;j nd W ). However, time-domain aliasing occurs due to the circular time shift within the frame. To achieve a time shift without time-domain aliasing the samples s 0, :::, s W; are padded with Z zeros at the beginning and the end of each frame and a DFT of size N =Z + W is used. The signal is processed frame-wise with such a zero-padded DFT, with W samples time advance between the DFTs, such that perfect reconstruction with an inverse DFT is achieved if the spectrum is not modied. A time shift within the range d [;Z Z] is implemented by modifying the resulting N spectral coecients according to ^S n = S n exp(;j nd N ) : () More generally speaking, the underlying signal can be ltered by multiplication of its frequency response S n with the frequency response H n of a lter, ^S n = S nh n : () As long as the lter's impulse response satises h[l] = 0 for jlj >Z () no aliasing occurs. Obviously, not only time-shifts can be implemented by ltering but also level modications. The described procedure is very similar to the overlapadd convolution method using DFT [0], only that the lter does not need to be causal. The described scheme works perfectly as long as the spectral modication is not varied over time k. When d varies over time the transitions have to be smoothed by using overlapping windows for the analysis transform. A frame of N samples is multiplied with an analysis window before an N-point DFT is applied. We use the following analysis window which includes zero padding at the beginning and at the end, w a[i] = 8 < : 0 for 0 i<z_ N ; Z i<n (4) sin ( (i;z) W ) for Z i<z+ W where Z is the width of the zero region before and after the non-zero part of the window. Figure 6 shows the described analysis window schematically. The non-zero window spanisw and the size of the transform is N = Z + W. Adjacent windows are overlapping and shifted AES TH ONVENTION, MUNIH, GERMANY, 00 MAY 0{

Z W Z Fig. 6: Analysis window. The time-span of the window is shorter than the DFT length N such that non-circular time-shifts within the range [;Z Z] are possible. by W= samples. The analysis window was chosen such that the overlapping windows add up to a constant value of one. Therefore, for synthesis in the decoder there is no need for additional windowing. A plain inverse DFT of size N with time advance of successive frames of W= samples is used. ommonly used time-frequency transforms such as the MDT [] use windowing for analysis and synthesis, e.g. a sine window. The condition for perfect reconstruction is that the overlapping analysis windows multiplied by the synthesis windows add up to a constant value of one. We are using windowing only for the analysis transform and choose the analysis window such that the overlapping windows add up to a constant value of one. When modifying the spectrum of the sum signal in the decoder, such as to impose a time shift, not only the underlying signal is shifted but also the imposed analysis window. Therefore, in the case when a synthesis window is used, the synthesis window does not match anymore the analysis window, resulting in distortions in the reconstructed signal. By not using a synthesis window these distortions are avoided. The uniformly spaced spectral coecients S n (0 n N=) are divided into B non-overlapping partitions such that each partition has a bandwidth proportional to the Equivalent Rectangular Bandwidth (ERB) [9]. Only the rst N= + spectral coecients of the spectrum are considered because the remaining coecients are symmetric to these and therefore redundant. We found that the frequency resolution was high enough when choosing the bandwidth of each partition equal to two ERB.The indices of the DFT coecients which belong to partition b are n fa b; A b; + ::: A b ; g with A0 =0. Figure 7 shows how the spectrum is divided into B partitions. For our experiments we used W = 896, Z = 64, and N = 04 for a sample rate of khz. Table shows the partition boundaries A b. The minimum size of one partition was limited to spectral coecients resulting A 0 0 A 5 8 A 0 69 A 5 0 A A 6 4 A 88 A 6 75 A 6 A 7 A A 7 4 A 9 A 8 4 A 40 A 8 47 A 4 A 9 54 A 4 76 A 9 5 Table : The partition boundaries Ab (0 b B) for the case of a partition width of two ERB,N = 04, and a sample rate of fs =khz. A 0 A A A A 4 A 5... A B PARTITION BOUNDARIES 0 π FREQUENY Fig. 7: The uniformly spaced spectral coecients are grouped into partitions which are approximately two ERB wide. in B =9.. Denition of ILD and ITD for Multiple hannels In the general case of playback channels the ILD and ITD are given for each channel relative to a reference channel. Without loss of generality, channel number is dened as the reference channel. Figure 8 shows how ILD and ITD are dened between the reference channel and each other channel for the b th partition. For example, fl ib ibg are the ILD and ITD between channel and channel i + for the b th partition.. ILD and ITD Estimation First, for each of the audio channels c the power within each partition b B is estimated, P c b = A b ; X n=a b; js c nj (5) where S c n are the spectral coecients of audio channel c. The estimated ILD in db between channel c and the reference channel for partition b is, L c; b =0log 0 ( P b c ) : (6) Pb At this point, the low complexity implementation of B presented in this paper does not estimate ITD. An ILD and ITD estimation algorithm based on a cochlear lterbank was presented in []..4 Quantization and oding of ILD and ITD The ILD and ITD (L i b, i b) are quantized with a uniform quantizer curve as shown in Fig. 9. An odd number of quantizer levels Q is used such that the quantizer levels are symmetric with respect to zero. The AES TH ONVENTION, MUNIH, GERMANY, 00 MAY 0{ 4

L -,b, τ -,b L,b, τ,b L,b, τ,b... Fig. 8: For the general case of channels ILD and ITD are dened relative to a reference channel for the b th partition. -a... QUANTIZER OUTPUT a -a... a QUANTIZER INPUT Fig. 9: A uniform quantizer with Q levels and a limited range [;a a] is used for quantizing the ILD and ITD. perceptually motivated range limits a for ILD are L max = 8 db and for ITD max = 400s. The quantizer indices are obtained by Li b(q ; ) I i b = b + L max c + Q ; i b(q ; ) J i b = b + max c + Q ; : (7) The oset Q; is added in order that the range of the quantizer indices is f0 ::: Q; g. In order to reduce the bitrate an entropy coder is used for encoding quantizer index dierences. For the experiments reported here we used Q = 5. There are f s=w input spectra per second. Thus, for each pair of audio channels there are Bf s=w ILD and ITD to be encoded. For the specic parameters we are using (as specied above) this results in 57 ILD and ITD to be encoded per second. The resulting average bitrate for ILD or ITD for one channel pair of the entropy coded quantizer indices is approximately kbit/s. B ILD AND ITD DEODING SPATIAL SYNTHESIS ILD ITD INVERSE INVERSE INVERSE -q... Fig. 0: Implementation of the B decoder. OUT 4 B DEODER IMPLEMENTATION Figure 0 shows the scheme of the B decoder that is used. First, the mono audio input signal is converted to the same spectral domain as is used for the B encoder (Section.). The B bitstream is decoded resulting in the quantized ILD and ITD ( ~ Li b, ~ i b). Given the spectrally decomposed mono audio input signal and the quantized ILD and ITD, the spatial synthesis generates the spectral representations of the output audio channels. These are converted back to the time domain. The switch shown in Fig. 0 with positions and has the following purpose: when in position (as shown) the ITD given from the B bitstream are synthesized. In case the switch is in position, ITD are synthesized proportionally to the ILD with a factor of ;q. In the latter case, there is no need for transmitting the ITD, thus the bitrate of the B bitstream is reduced to about one half. The factor is chosen to be ;q such that positive values of q result in ITD shifting the phantom image in the same direction as the given ILD. The following sections describe the functionality of Fig. 0 in detail. 4. ILD and ITD Decoding The B bitstream is decoded resulting in the quantizer indices I i b and J i b. The quantized ILD and ITD are obtained from the quantizer indices (7) by Li b ~ = Lmax Q Q ; (Ii b ; ; ) ~ i b = max Q Q ; (Ji b ; ; ) : (8) 4. Spatial Synthesis Given the spectral coecients ~ Sn of the mono sum signal, the spectral coecients ~ S c n for each channel c are obtained by ~S c n = F c ng c n ~ S n (9) AES TH ONVENTION, MUNIH, GERMANY, 00 MAY 0{ 5

where F c n is a positive real number determining a level modication for each spectral coecient n and G c n is a complex number of magnitude one determining a phase modication for each spectral coecient. The following two paragraphs describe how F c n and G c n are obtained given f ~ Lcb ~ cbg. c arg[g n ] PARTITION b A b- A b Determining the Level Modication for Each hannel The factors Fn c for channel c> are computed, for each spectral coecient within a partition b (A b; n<a b), given L ~ c; b, F c n =0 ( ~L c; b )=0 F n : (0) The factors Fn c for the reference channel are computed such that the sum of the power of all channels is the same as the power of the mono signal for each partition: vu X ; Fn == t + 0 ~L ib =0 : () i= Before applying (9), F c n is smoothed at the partition boundaries to reduce frequency aliasing artifacts. Determining the Phase Modication for Each hannel The complex factors G c n for channel c> are computed, for each spectral coecient within a partition b (A b; n<a b), given ~ c; b, G c n = exp(;j n~c; b ; b ) () N where b is the delay which isintroduced into reference channel, b = ( max ~ib + min ~ib)= i< i< G n = exp(;j nb N ) : () The delay for the reference channel b as computed in () results in a maximum absolute delay introduced to any channel in a specic partition that is minimal. Figure shows an example of arg[g c n] for synthesizing three dierent delays in partitions of one audio channel c. 5 RESULTS We compared B enhanced mono audio coders with conventional stereo audio coders at various bitrates. Each conventional stereo audio coder was compared with a B scheme that used the same audio coder for encoding the mono sum signal. For that purpose we used PA and MP (MPEG- Layer III []). The MP encoder used is incorporated into Apple's itools program (by Fraunhofer Institute). The rows in Table show the 0 Fig. : The phase of G c n for the synthesis of ITDs as delays. oder Bitrate for Stereo Bitrate for B Based oder PA () 64 kbit/s () 5 + kbit/s PA () 56 kbit/s () 5 + kbit/s MP (4) 40 kbit/s (5) + kbit/s Table : The coders and bitrates for the three subjective tests conducted. The numbers (-5) denote the ve dierent coding congurations. bitrates of the audio coders for encoding the stereo signals and the mono signals when used with B. The bitrates of the B schemes are shown as the sum of the mono audio coder bitrate and the B bitstream bitrate. The mono audio coder bitrate is chosen lower than the bitrate for stereo because for the same level of distortion and audio bandwidth less bits are needed to encode the mono. For PA wechose a sampling rate of khz and an audio bandwidth of :5 khz. The parameters for the MP encoder were chosen as shown in Fig. for a bitrate of 40 kbit/s for stereo and kbit/s for mono when used with B. For PA and MP we chose the xed bitrate encoding mode. For a lower bitrate of the B bitstream, only ILD are used as spatial cues. The switch in the B decoder (Fig. 0) is set to position with a ILD-to-ITD scaling factor of q =:0 0 ;5 s/db. With an ILD range of 8 db this results in an ITD range of 80 s. Informal listening revealed that for headphone playback q =:0 0 ;5 s/db delivers improved quality over the case of only synthesizing ILD (q = 0). However, for loudspeaker playback q has very little impact on the perception of the sound. For each of the tests we chose the same 4 music clips. Each of these clips has a pronounced wide spatial image. B is challenged by a wide spatial image in the sense that it needs to perceptually separate audio sources. Also, for the conventional stereo audio coder a n AES TH ONVENTION, MUNIH, GERMANY, 00 MAY 0{ 6

INDIVIDUAL ITEMS AVERAGE GRADING 0 Fig. : The MP encoder was used with the options shown for a bitrate of 40 kbit/s for stereo and kbit/s for mono when used with B. INDIVIDUAL ITEMS AVERAGE A B D E F G H I K Fig. 4: Relative grading of the B based coder operating at a bitrate of 5 + kbit/s versus stereo PA at56kbit/s (same grading scale as Fig. ). GRADING 0 A B D E F G H I K Fig. : Relative grading of the B based coder operating at a bitrate of 5 + kbit/s versus stereo PA at 64 kbit/s (B is better than PA for positive gradings, : slightly better, : better, : much better). wide spatial image is challenging because the redundancy between the channels is small in that case resulting in a high bit demand. Dierent kinds of music signals such as Jazz, Rock, and percussive music were selected. Four of the clips were used as training items and ten as test items. The tests were carried out with a two loudspeaker setup using high-end audio equipment with the listener's head located in the sweetspot. The type of test was a blind triple-stimulus test (ITU-R Rec. BS.56. [4]) to grade the quality dierence with respect to a reference using a seven-grade comparison scale. For each test ten listeners were asked to participate. The ten listeners were presented with triples of signals, each ofslength for each trial. The uncoded source signal (reference) was presented rst followed by the coded clips of the conventional stereo audio coders and B based coders in random order. Figures, 4, and 5 show the results of the three subjective tests. Positive gradings correspond to preference for the B based schemes. For every test, the total bitrate of the B based scheme was lower than the bitrate of the stereo audio coder. For the average of each test, the B based scheme outperforms the stereo audio coder despite its lower bitrate. It has to be noted that the artifacts of the two coding schemes are quite dierent. The B based coder generally modies the spatial image more, while the conventional stereo audio coders introduce more distortions. oncluding from the test results, the listeners have clearly preferred the case of less distortions over the case of a modied spatial image. Derived from the test results (Figs., 4, and 5), Fig. 6 shows qualitatively the subjective quality ofeach coding conguration that was used for the tests (the same numbering as in Table is used): () Stereo PA 64 kbit/s, () Stereo PA 56 kbit/s, () B with mono PA 5 + kbit/s, (4) Stereo MP 40 kbit/s, and (5) B with mono MP + kbit/s. At bitrates high enough for transparent or nearly transparent coding, the conventional coder is better since B can generally not achieve transparency. The test results give an indication that for bitrates lower than about 64 kbit/s the B based coding scheme has better quality than conventional perceptual transform audio coders for stereo. The lower the bitrate the more is the B based coding scheme at an advantage. The B decoder processes the mono audio signal and the quantization noise introduced by the mono audio AES TH ONVENTION, MUNIH, GERMANY, 00 MAY 0{ 7

GRADING 0 INDIVIDUAL ITEMS A B D E F G H I K AVERAGE Fig. 5: Relative grading of the B based coder operating at a bitrate of + kbit/s versus stereo MP at 40 kbit/s (same grading scale as Fig. ). TRANSPARENT QUALITY ANNOYING ONVENTIONAL STEREO ODER 5 4 B ENHANED ODER 0 0 40 60 80 00 BITRATE [kbit/s] Fig. 6: At bitrates at which conventional perceptual transform audio coders operate near a transparent quality these are better than B based schemes. At lower bitrates B enhanced coders are better on average. coder identically. Therefore, the audio signal and quantization noise are always perceptually located in the same direction for each frequency. It is our experience that if the signal and quantization noise are always perceptually located at the same direction an independent perceptual model [5] can determine the masked threshold for each audio channel. In other words, no BMLD needs to be considered. An important consequence of this is that existing mono audio coders and speech coders can be used to encode the sum signal without introducing unmasking artifacts that would result from BMLD. For the kinds of music signals chosen for the tests (Jazz, Rock, and percussive music), B generally provides a very good quality of the spatial image. There are some signals which B modies perceptually more than others. Especially at this point B is not capable of reproducing diuse phantom sources. lips most aected by this limitation are recordings with a high amount of reverberation, e.g. classical recordings in large concert halls. 6 ONLUSIONS This paper presented in detail schemes that apply Binaural ue oding (B) to stereo and multi-channel audio compression. A stereo or multi-channel audio signal is represented as the sum signal of all audio channels and a B bitstream. The sum signal is encoded using conventional audio coders or speech coders. The bitrate of the B bitstream is very low compared to the bitrate necessary for encoding the sum signal. Therefore, stereo and multi-channel audio signals are encoded with a bitrate nearly as low as encoding mono audio signals. The scheme has low computational complexity and is suitable for real-time implementation. A series of subjective tests suggest that the B scheme presented provides better quality at bitrates lower than about 64 kbit/s than traditional transform based perceptual audio coders. Informal listening revealed that the presented B scheme performs also well for multi-channel audio compression. AKNOWLEDGEMENTS Thanks to Peter Kroon, Yair Shoham, and Martin Vetterli for the valuable suggestions. REFERENES []. Faller and F. Baumgarte, \Ecient representation of spatial audio using perceptual parametrization," in IEEE Workshop on Appl. of Sig. Proc. to Audio and Acoust., Oct. 00. []. Faller and F. Baumgarte, \Binaural cue coding: Anovel and ecient representation of spatial audio," in Proc. IASSP 00 (accepted), Orlando, Florida, May 00. [] J. Blauert, Spatial Hearing. The Psychophysics of Human Sound Localization, MIT Press, 98. [4] M. Bosi, K. Brandenburg, S. Quackenbush, L. Fielder, K. Akagiri, H. Fuchs, M. Dietz, J. Herre, G. Davidson, and Y. Oikawa, \ISO/IE MPEG- advanced audio coding," J. Audio Eng. Soc., vol. 45, no. 0, pp. 789{84, 997. [5] D. Sinha, J. D. Johnston, S. Dorward, and S. Quackenbush, \The perceptual audio coder (PA)," in The Digital Signal Processing Handbook, V. Madisetti and D. B. Williams, Eds., chapter 4. R Press, IEEE Press, Boca Raton, Florida, 997. AES TH ONVENTION, MUNIH, GERMANY, 00 MAY 0{ 8

[6] J. D. Johnston and A. J. Ferreira, \Sum-dierence stereo transform coding," in IASSP-9 onference Record, 99, pp. 569{57. [7] J. Herre, K. Brandenburg, and D. Lederer, \Intensity stereo coding," in Proc. AES 96th onvention, Feb. 994. [8] F. Baumgarte and. Faller, \Why binaural cue coding is better than intensity stereo," in Proc. th onv. Aud. Eng. Soc., May 00. [9] B. R. Glasberg and B.. J. Moore, \Derivation of auditory lter shapes from notched-noise data," Hear. Res., vol. 47, pp. 0{8, 990. [0] A. V. Oppenheim and R. W. Schaefer, Discrete- Time Signal Processing, Signal Processing Series. Prentice Hall, 989. [] H. S. Malvar, Signal processing with lapped transforms, Artech House, 99. [] F. Baumgarte and. Faller, \Estimation of auditory spatial cues for binaural cue coding (B)," in Proc. IASSP 00 (accepted), Orlando, Florida, May 00. [] K. Brandenburg and G. Stoll, \ISO-MPEG- audio: a generic standard for coding of high-quality digital audio," J. Audio Eng. Soc., pp. 780{79, Oct. 994. [4] ITU-R Rec. BS.56., 990, http://www.itu.org. [5] J. L. Hall, \Auditory psychophysics for coding applications," in The Digital Signal Processing Handbook, V. Madisetti and D. B. Williams, Eds., pp. 9{:9{. R Press, IEEE Press, 998. AES TH ONVENTION, MUNIH, GERMANY, 00 MAY 0{ 9