Digital Media. Daniel Fuller ITEC 2110

Similar documents
3 Sound / Audio. CS 5513 Multimedia Systems Spring 2009 LECTURE. Imran Ihsan Principal Design Consultant

A Digital Audio Primer

Audio Fundamentals, Compression Techniques & Standards. Hamid R. Rabiee Mostafa Salehi, Fatemeh Dabiran, Hoda Ayatollahi Spring 2011

CHAPTER 10: SOUND AND VIDEO EDITING

08 Sound. Multimedia Systems. Nature of Sound, Store Audio, Sound Editing, MIDI

Wolf-Tilo Balke Silviu Homoceanu Institut für Informationssysteme Technische Universität Braunschweig

Principles of Audio Coding

Capturing and Editing Digital Audio *

Data Representation. Reminders. Sound What is sound? Interpreting bits to give them meaning. Part 4: Media - Sound, Video, Compression

Chapter 5.5 Audio Programming

Digital Recording and Playback

Export Audio Mixdown

Fundamental of Digital Media Design. Introduction to Audio

Skill Area 214: Use a Multimedia Software. Software Application (SWA)

ITNP80: Multimedia! Sound-II!

3.01C Multimedia Elements and Guidelines Explore multimedia systems, elements and presentations.

COS 116 The Computational Universe Laboratory 4: Digital Sound and Music

2.4 Audio Compression

Perceptual Coding. Lossless vs. lossy compression Perceptual models Selecting info to eliminate Quantization and entropy encoding

COS 116 The Computational Universe Laboratory 4: Digital Sound and Music

EUROPEAN COMPUTER DRIVING LICENCE. Multimedia Audio Editing. Syllabus

Sound 5 11/21/2016. Use MIDI and understand its attributes, especially relative to digitized audio.

Digital Audio. Amplitude Analogue signal

Mpeg 1 layer 3 (mp3) general overview

Audio-coding standards

Perceptual coding. A psychoacoustic model is used to identify those signals that are influenced by both these effects.

Audio-coding standards

Data Compression. Audio compression

CS 074 The Digital World. Digital Audio

Both LPC and CELP are used primarily for telephony applications and hence the compression of a speech signal.

Digital Media. Daniel Fuller ITEC 2110

Lecture #3: Digital Music and Sound

For Mac and iphone. James McCartney Core Audio Engineer. Eric Allamanche Core Audio Engineer

Inserting multimedia objects in Dreamweaver

Chapter 14 MPEG Audio Compression

ICT 514 Multimedia Systems Topic 4: Audio

Audacity: How- To. Import audio (a song or SFX) Before we start. Import song into Audacity

5: Music Compression. Music Coding. Mark Handley

Lossy compression. CSCI 470: Web Science Keith Vertanen

Introduction to Audacity

CSC 101: Lab #7 Digital Audio Due Date: 5:00pm, day after lab session

Extraction and Representation of Features, Spring Lecture 4: Speech and Audio: Basics and Resources. Zheng-Hua Tan

Introducing Audio Signal Processing & Audio Coding. Dr Michael Mason Snr Staff Eng., Team Lead (Applied Research) Dolby Australia Pty Ltd

Multimedia Systems Speech I Mahdi Amiri September 2015 Sharif University of Technology

CHAPTER 2 - DIGITAL DATA REPRESENTATION AND NUMBERING SYSTEMS

Introducing Audio Signal Processing & Audio Coding. Dr Michael Mason Senior Manager, CE Technology Dolby Australia Pty Ltd

AudioLiquid Converter User Guide

Audio Compression. Audio Compression. Absolute Threshold. CD quality audio:

McFunSoft Audio Studio

AUDIOVISUAL COMMUNICATION

Chapter 7: Working with Digital Sounds

Digital Media IB DESCRIPTION. EXAM INFORMATION Items

Multimedia Systems Speech I Mahdi Amiri February 2011 Sharif University of Technology

Mathematically Tuned into Sound Analyzing the Sound of a Tuning Fork. Group Members:

Fundamentals of Perceptual Audio Encoding. Craig Lewiston HST.723 Lab II 3/23/06

STRANDS AND STANDARDS DIGITAL MEDIA 1B

CSCD 443/533 Advanced Networks Fall 2017

EE482: Digital Signal Processing Applications

AUDIOVISUAL COMMUNICATION

Using ADOBE SOUNDBOOTH CS5

Intro To Pure Data Documentation

REVIEW: PROCEDURES FOR PRODUCING AUDIO

Networking Applications

_APP B_549_10/31/06. Appendix B. Producing for Multimedia and the Web

GUIDELINES FOR THE CREATION OF DIGITAL COLLECTIONS

Digitization of Multimedia Elements

Sampling & Sequencing. Combining MIDI and audio

计算原理导论. Introduction to Computing Principles 智能与计算学部刘志磊

CHAPTER 6 Audio compression in practice

Digital Audio Basics

Nero SoundTrax Manual

KLARSTEIN USB TURNTABLE - User's manual

Principles of MPEG audio compression

95.9 fm CKUW Policies & Procedures

INSTRUCTION MANUAL L-3866USB

Compressed Audio Demystified by Hendrik Gideonse and Connor Smith. All Rights Reserved.

Lecture 16 Perceptual Audio Coding

ITEC 120 2/25/11. Review. Objectives. Sound. Arrays. Lecture 18 Sound. See a real world usage of arrays

TURNTABLE PLAYER GE4056 READ INSTRUCTIONS CAREFULLY BEFORE USE AND STORE IN A SAFE PLACE FOR FUTURE REFERENCE

Audio Coding and MP3

Appendix 4. Audio coding algorithms

AET 1380 Digital Audio Formats

CS 4455: Video Game Design & Implementation

Elementary Computing CSC 100. M. Cheng, Computer Science

Sound Lab by Gold Line. Noise Level Analysis

DIY Audio Rosanne Hutton, MindCross Training

Rich Recording Technology Technical overall description

How to edit audio tracks

Speech-Coding Techniques. Chapter 3

Sources:

AUDIO MEDIA CHAPTER Background

Bluray (

Digital Music. You can download this file from Dig Music May

Audacity tutorial. 1. Look for the Audacity icon on your computer desktop. 2. Open the program. You get the basic screen.

DSP. Presented to the IEEE Central Texas Consultants Network by Sergio Liberman

Really Easy Recording & Editing

fffasdf Pro Tools App 2 Week 1 Chapter 1: Basics I Chapter 1: Basics I 2017 Dajaun Martineau 1

CG087 Time-based Multimedia Assets 5. Chapter 5 Sampling & Sequencing: Combining MIDI and audio. Introduction. Recording sound

Introducing working with sounds in Audacity

9/8/2016. Characteristics of multimedia Various media types

Transcription:

Digital Media Daniel Fuller ITEC 2110

Daily Question: Digital Audio What values contribute to the file size of a digital audio file? Email answer to DFullerDailyQuestion@gmail.com Subject Line: ITEC2110-09

Housekeeping Project 1 description is on the wiki Due 9/14 by 11:59 PM Log out of your computer before you leave

Chapter 4 Fundamentals of Digital Audio Part 1 The Nature of Sound Wave

Sound A wave that is generated by vibrating objects in a medium such as air Examples of vibrating objects: Vocal cords of a person Guitar strings Tuning fork

So how is vibration turned into sound we can hear or record with a microphone??? Recorded Sound

An illustration of how the propagating sound wave formed by changes of the air pressure reaches the microphone tuning fork air molecules microphone

An illustration of how the propagating sound wave formed by changes of the air pressure reaches the microphone

Let's step through the process slowly

The changes of pressure in the propagating sound wave reaching the recorder are captured as changes of electrical signals over time.

The sound wave can be represented graphically with the changes in air pressure or electrical signals plotted over time a waveform.

Be careful... NOT to interpret sound as a wave that has crests and troughs NOT to interpret the waveform as a representation of the sound wave in space i.e. air molecules are not going up and down

Frequency of Sound Wave Refers to the number of complete backand-forth cycles of vibrational motion of the medium particles per unit of time Unit for frequency: Hz (Hertz) 1 Hz = 1 cycle/second

Frequency 1 second a cycle a cycle Frequency = 2 Hz (i.e., 2 cycles/second)

Frequency 1 second a cycle a cycle a cycle a cycle Frequency = 4 Hz (i.e., 4 cycles/second) Higher frequency than the previous waveform.

Pitch of Sound Sound frequency Higher frequency: higher pitch human ear can hear sound ranging from 20 Hz to 20,000 Hz

Sound Intensity vs. Loudness Sound intensity: An objective measurement Can be measured with auditory devices Measured in decibels (db) Loudness: A subjective perception Measured by human listeners Human ears have different sensitivity to different sound frequency In general, higher sound intensity means louder sound

Application of Decibels Many audio-editing programs use decibels for the audio amplitude 3 decibels: doubling the sound intensity 6 decibels: doubling the electrical voltages corresponding to the sound Let's see why 3 and 6 decibels.

Decibels Number of decibels = 10 log = I I ref V 20 log V 1 1 ref I 1 and I ref = sound intensity values in comparison V 1 and V ref = corresponding electrical voltages

Decibels when doubling the sound intensity Number of decibels = 10 log = 10 log 10 0.3 = 3 ( 2) I 1 I ref

Decibels when doubling the electrical voltages Number of decibels 20 log V1 = = 20 log 20 0.3 = 6 ( 2) V ref 22

Decibels Note the ratio of intensities or voltages in the equation Number of decibels is not an absolute measurement but in comparison to a reference (I ref or V ref )

Decibels 0 db: Threshold of hearing Minimum sound pressure level at which humans can hear a sound at a given frequency Does NOT mean zero sound intensity Does NOT mean absence of sound wave ~120 db: Threshold of pain Sound intensity that is 10 12 times greater than 0 db

A Simple Sine Wave Waveform A single sine wave waveform A single tone

Adding Sound Waves A single sine wave waveform A single tone A second single sine wave waveform A second single tone A more complex waveform A more complex sound

Waveform Example A waveform of the spoken word "one"

Waveform Example Let's zoom in to take a closer look

Waveform Example A closer look

Chapter 4 Fundamentals of Digital Audio Part 2 Digitizing Sound

Digitizing Sound Suppose we want to digitize this sound wave:

Step 1. Sampling The sound wave is sampled at a specific rate into discrete samples of amplitude values.

Effects of Sampling Rate original waveform sampling rate = 10 Hz sampling rate = 20 Hz

Effects of Sampling Rate Higher sampling rate: The reconstructed wave looks closer to the original wave More sample points, and thus larger file size

Sampling Rate vs. Sound Frequency Both uses the unit Hz HOWEVER: Sampling rate sound frequency Sample rate: a setting in the digitization process Sound frequency: NOT a setting in the digitization process Sound frequency: the pitch characteristic of sound Higher sampling rate: NOT the pitch characteristic of sound

Step 2. Quantization Each of the discrete samples of amplitude values obtained from the sampling step are mapped and rounded to the nearest value on a scale of discrete levels. An 8-bit audio allows 2 8 = 256 possible levels in the scale CD-quality audio is 16-bit (i.e., 2 16 = 65,536 possible levels)

Step 2. Quantization Suppose we are quantizing the samples using 3 bits (i.e. 2 3 = 8 levels).

Step 2. Quantization Now, round each sample to the nearest level.

Step 2. Quantization Now, reconstruct the waveform using the quantized samples.

Bit Depth Bit depth of a digital audio is also referred to as resolution. For digital audio, higher resolution means higher bit depth.

Dynamic Range The range of the scale, from the lowest to highest possible quantization values

Smaller than the Full Range

43

Chapter 4 Fundamentals of Digital Audio Part 3 File Size, File Compression, and File Types of Digital Audio

General Strategies to Reduce Digital Media File Size Reduce sampling rate Reduce bit depth Apply compression For digital audio, these are also these options: Reduce the number of channels Shorten the length of the audio

Reduce Sampling Rate Sacrifices the fidelity of the digitized audio Need to weigh the quality against the file size Need to consider: Human perception of the audio (e.g., How perceptibe is the audio with lower sampling rate?) How the audio is used Music: may need higher sampling rate Short sound clips such as explosion and looping ambient background noise: may work well with lower sampling rate

Sampling Rate Examples 11,025 Hz AM Radio Quality/Speech 22,050 Hz Near FM Radio Quality (highend multimedia) 44,100 Hz CD Quality 48,000 Hz DAT (digital audio tape) Quality 96,000 Hz DVD-Audio Quality 192,000 Hz DVD-Audio Quality

Nyquist Rate We must sample at least 2 points in each sound wave cycle to be able to reconstruct the sound wave satisfactorily. Sampling rate of the audio twice of the audio frequency Sampling rate of the audio is higher for audio with higher pitch

Human Hearing Range Human hearing range: 20 Hz to 20,000 Hz Most sensitive to 2,000 Hz to 5,000 Hz

Effect of Sampling Rate on File Size File size = duration sampling rate bit depth number of channels File size is reduced in the same proportion as the reduction of the sampling rate Example: Reducing the sampling rate from 44,100 Hz to 22,050 Hz will reduce the file size by half.

Effect of Bit Depth on File Size File size = duration sampling rate bit depth number of channels File size is reduced in the same proportion as the reduction of the bit depth Example: Reducing the bit depth from 16- bit to 8-bit will reduce the file size by half.

Most Common Choices of Bit Depth 8-bit Usually sufficient for speech In general, too low for music 16-bit Minimal bit depth for music 24-bit 32-bit

Effect of Number of Channels on File Size File size = duration sampling rate bit depth number of channels File size is reduced in the same proportion as the reduction of the number of channels Example: Reducing the number of channels from 2 (stereo) to 1 (mono) will reduce the file size by half.

Common Audio File Types AIFF WAV AU MP3 MOV WMA SWA ASF MIDI

Choosing an Audio File Type Determined by the intended use File size limitation Intended audience Whether as a source file

File Size Limitations Is your audio used on the Web? File types that offer high compression Streaming audio file types

Intended Audience What is the equipment that your audience will use to listen to your audio? If they are listening on computers, what are their operating systems? Cross-platform vs. single platform

Whether as a Source File If you are keeping the file for future editing, choose a file type: Uncompressed Allows lossless compression

Questions?

Homework Read Ch. 5 Work on Project 1

"Digital Media Primer" Yue-Ling Wong, Copyright (c)2011 by Pearson Education, Inc. All rights reserved.