EE 412/CS455 Principles of Digital Audio and Video Instructor s Name: Nadeem A. Khan Year: 2011-2012 Office No. & Email: Room 426, nkhan@lums.edu.pk Category: Senior, Junior and Graduates (Elective) Course Code (Units) Course Description EE 412/CS455 Principles of Digital Audio and Video (3 Units) This course provides the student with basic concepts and techniques regarding digital audio and video in multimedia systems. Topics include: Introduction to multimedia systems its components and applications, digital signal processing of audio, images, and video data in multimedia systems and their formats. Introduction is also given regarding compression and communication of audio and video media. Assignments and home works will be geared towards this goal. This course is intended to be a foundation course for the multimedia/vision/image processing concentration area. It is designed for undergraduate-level students majoring in Electrical Engineering and Computer Science. However most of the graduate students will find it equally useful.
Core/Elective Pre-requisites Goals This course is an elective for undergraduate and graduate Computer Science and Electrical Engineering students. Only for EE and CS and students at one of the following levels: Junior, Senior, Graduate; Some programming knowledge/experience in Matlab, C, C++ (like CS100 and CS200) is required (Recommended: Signal and Systems, Computer Organization and Assembly, Digital Logic Design ). Students with no background in Signal and Systems will have to attend a few mandatory tutorials. To build the necessary background for advanced courses in the Multimedia/Vision and Image Processing related streams
EE 412/CS 455 Principles of Digital Audio and Video Year: 2011-2012 TextBooks, Programming Environment, etc. Main Textbook: Reading Package (available at the photocopy machine) Additional course notes and reading material will be given. Additional Readings and Reference : (i) (ii) (iii) (iv) (v) Principles of digital audio and video by Arch C. Luther, Artech House Inc., Latest Addition Digital Image Processing/2E, R.C. Gonzalez, R.E. Woods, Addison-Wesley, 2002 Multimedia Signals and Systems by Mrinal Kr. Mandal, Kluwer Academic Publishers, Latest Addition Multimedia Communications Applications, Networks, Protocols and Standards, Fred Halsall, Pearson Education (Singapore) Pte. Ltd., Latest Addition Fundamentals of Multimedia, Li and Drew, Pearson Education, Inc (USA), 2004-2006 (vi) Introduction to Multimedia Systems, Edited by G. Bhatnager, S. Mehta, S. Mitra, Elsevier,2002 Programming Environment: Matlab, C/C++ Lectures, Tutorials & Attendance Policy There will be 28 sessions including one in-class mid-term and one final examination. Theory sessions will be of 75 minutes each and Practical sessions will be of 2 hrs and 20 mins. Assignment 2 which is based on reviewing basic Signal and systems concepts will be differently structured and graded for students with no signal and systems background. One or two initial tutorials will also be
compulsory to attend for background makeup. Class attendance is strongly advised. However, students missing lectures will find it very difficult to make up for the content covered. Grading Assignments/Labs: 16% Project: 10% Quizzes: 19% Midterm Exam: 25% Final Exam: 30%
EE 412/CS 455 Principles of Digital Audio and Video Year: 2011-2012 Module Topics Sessions Readings 1 Intro:Multimedia World and Digital Audio and Video Multimedia Systems, Applications, Production and Authoring Multimedia data: - Text - Audio (Speech and Music) - Images - Video - Graphics Analog vs Digital Signals and Technology Applications in the area of Computer Vision, Multimedia Communication, Media Compression, Digital Libraries and Searching Future Trends and Research areas 1 Luther: Ch 13, Ch 4, Ch 12 /Handouts /Slides Luther: Ch 1 Handouts / Slides Luther: Ch. 13, Ch. 14 Slides/ Handouts
2 Audio & Video Fundamentals Audio Fundamentals: Properties of natural sound and music, human hearing, Exploitation in electronic devices Video Fundamentals: Human vision fundamentals and its exploitation in reproduction in Electronic Devices, Color Systems 1+2 Luther: Ch 2, Ch 3, Handouts / Slides (Halsall:Ch. 2, Mandal: Ch.2)
EE 412/CS 455 Principles of Digital Audio and Video Year: 2011-2012 Module Topics Sessions Readings 3 Signal Capturing and Analog to Digital Conversion -Review of Frequency Domain Analysis of Signals - Frequency Spectrum of Analog and Digital Signals - Electronic Capturing of Audio and Video - Analog-to-Digital Conversion of Audio, Images and Video: Process and Issues 1+1+3 Luther: Ch 5, Ch 6 (sections), Gonzalez Chapter 4 Handouts / Slides 4 Analog and Digital Signal Formats and Standards - Analog Standards (short review) - Digital Formats and Standards (for raw digital data) 2 Luther: Ch 2, Ch 3 (sections) Handouts / Slides
5 Techniques of Audio and Video Signal Processing - Review of Basic concepts of Filtering and Convolution - 1-D Filters, (Spatial) Image Filtering - Signal Interpolation, Decimation - Processing Examples - Signal Processing Hardware/ Software Requirements Lab sessions on Audio and Video Processing 6+2 Luther: Ch 8 Gonzalez: Ch 2, 3,4 Handouts / Slides
EE 412/CS 455 Principles of Digital Audio and Video Year: 2011-2012 Module Topics Sessions Readings 6 Techniques of Media (Audio/Video) Compressions and Standards Data Compression Basics: Lossless and Lossy Techniques 5 Luther: Ch 9 Halsall: Ch 4 Handouts / Slides Audio Compression Techniques and Standards Video Compression Techniques and Standards (Introduction to Transform Coding) - Error Detection and Correction 7 Project Activities Proposal and Design Presentation Implementation work and Intermediate review Final Demonstration and Evaluation 3 MIDTERM (session to be announced by PCO) 1 FINAL EXAM