COURSE TITLE: ECE 421 Multimedia Signal Processing

CATALOG DESCRIPTION: Fundamentals of processing multimedia signals: text, graphics, speech, audio, image, video; standards for multimedia coding, processing and compression. Related products and services will be discussed.

REQUIRED TEXTS: Khalid Sayood, Introduction to Data Compression, Morgan Kaufmann, 2^nd edition, 2000.

COURSE DIRECTOR: Aggelos Katsaggelos

COURSE GOALS: To provide an introduction to the fundamental principles and techniques in multimedia signal processing and compression, an overview of the current multimedia standards and technologies, and a brief description of future technologies.

PREREQUISITES BY COURSES: ECE 359 or equivalent or permission of the instructor.

DETAILED COURSE TOPICS:

Digital Processing Basics

Multimedia Processing and Communications

Compression and Networking as Cornerstones

Information Theory Basics

Lossless Source Coding

Huffman/arithmetic Codes, LZW

Text/graphics Compression

Fax Standards (Group 3, Group 4, JBIG)

Quantization (scalar/vector)

Waveform, Transform, Model-based Coding

Performance Criteria, Perception

Human Visual System Models

Still Image Compression

JPEG, JPEG2000

Wavelet/Subband/Fractal

Perceptually-based Coders

2^nd Generation Image Coding

Speech Production

Speech Compression

LPC, CELP, MELP

Applications

Audio Compression

The G.72X Standars

Fundamentals of Perceptual Coders

MPEG-1/2, Dolby AC-2 and AC-3

Compression of Stereo and Surround Sound

Video Compression Basics

Motion Estimation and Compensation

Rate-Distortion based Optimal Encoding

Overview of Multimedia Communication Standards H.323 and H.324

Video Compression Standards H.261, H.263

Video Compression Standards MPEG-1, MPEG-2, and HDTV

Applications/Consumer Electronic Products

“Modern” Coding Techniques

MPEG-4

Coding of Audio Objects (natural, synthetic)

Coding of Visual Objects (boundary encoding)

Sprites, Facial Animation

MPEG-7

Applications

Multimedia Transmission

Error Resilience and Concealment

Multimedia over IP

Multimodal Signal Processing

Speech-assisted Video Coding

Multimodal Speech Recognition

COMPUTER USAGE: None.

PROJECT: A bibliographical search or computer type project is required. The purpose of this project is to enhance the understanding of a topic covered in class or to investigate a topic not covered in class. A final report and a presentation are required.

GRADES:

Homework Assignments – 60%

Project – 40%

COURSE OBJECTIVES: When a student completes this course, s/he should be able to:

1. Understand the fundamentals behind multimedia signal processing.

2. Understand the fundamentals behind multimedia compression.

3. Understand the basic principles behind existing multimedia compression and communication standards.

4. Understand future multimedia technologies.

5. Apply the acquired knowledge to specific multimedia related problems and projects at work.

6. Take advanced courses in this area.