COMP9519: Multimedia Systems

Prerequisite: COMP2011 or COMP2711 or COMP9024. Must have completed 12 UOC of level 3 or above courses.

Lecturers: Associate Professor Jian Zhang (Lecturer-in-Charge)

Lectures: S2 2009, Thur 6-9 PM. Room: M14, The Chemical Sciences Building, UNSW

Consultation: Wed 3-4 PM Level 4 UNSW L5 Building (NICTA) (from Week2)

UOC: 6

Parallel Teching

This course may be taken both by postgraduate students and senior undergraduate students

Learning Outcomes

Multimedia systems covers the key principles, techniques and applications of multimedia technology. Students who complete this course will have experience with

Basic concepts of image/video coding technology and compression standards

Basic concepts of internet streaming media

Fundamentals of multimedia content description and presentation

fundamentals of content based image and video retrieval techniques

Basic knowledge of multimedia database system -- indexing, browsing and retrieval

and familiarity at an introductory level with examples of audio, image and video processing techniques in multimedia systems. After learning this course, it would be a significant step for students either to pursuer academic post-graduate study or to join industrial R/D organizations.

Course Outlines

Recommended References

Policy on Copying Assignments

Continual Course Improvement

Subject Contents

Lecture 1 -- Introduction & Image and Video Coding Techniques (part 1)
Multimedia Applications; Introduction to Multimedia Research; Basic Concepts in Multimedia Signal Processing; Spatial Redundancy in Images; Lossless & Predictive Coding (entropy coding); Introduction to Image Quantization
Lecture 2 -- Image and Video Coding Techniques (part 2)
Transform coding; Still Image Coding Standard (JPEG); Subband Coding; Temporal Redundancy & Temporal Predictive Coding for Video; Motion Estimation & Compensation
Lecture 3 -- Video Compression Standards (part 1)
Human Visual System (HVS) Characteristics; Digital Video Coding (DVC) Structure; Digital Video Coding standards: ITU-T H.261, ISO/IEC MPEG-1 & MPEG-2; Assignment 1 Introduction
Lecture 4 -- Video Compression Standards (part 2)
MEPG-2 Error Resilience/Error Concealment; Introduction to MPEG-4 Video Standard; Introduction to JVC (IUT-T&MPEG) H.264
Lecture 5 -- Internet Streaming Media
Internet Streaming Media Architecture: Client / Server Architecture; Issues of Real-time Delivery - delay, packet loss, error resilience, QoS; Real-time Data Transport: Real-time Transport Protocol (RTP); Control Protocol / QoS Feedback (RTCP); Example - RTP Payload format for MPEG-4
Lecture 6 -- Multimedia Presentation
Session Description Protocol (SDP), Real Time Streaming Protocol - "internet VCR controls", Inter-media synchronization; File Formats: Multimedia File Formats - requirements and features; Example MP4
Lecture 7 -- Multimedia Content Description
Need for Meta Data to Describe Content; Goals of MPEG-7 - Multimedia Content Description Interface; MPEG-7 Description Schemes for Content Management: Information on Creation and Production of Media Content; Description of Compression, Profile, Storage Format of Content
Lecture 8 -- Multimedia Information Retrieval (part 1)
Introduction to Image Indexing and Retrieval; Color Feature Extraction; Color based Image Indexing and Retrieval Techniques.
Lecture 9 -- Multimedia Information Retrieval (part 2)
Texture and Shape based Image Indexing and Retrieval;Assignment 1 Review and Assignment 2 Introduction
Lecture 10 -- Multimedia Information Retrieval (part 3)
Introduction to Video Indexing and Retrieval; Video Shot Detection and Segmentation; Video Segmentation in Compress Domain; Basic Techniques of Video Based Indexing and Retrieval
Lecture 11 -- Multimedia Signal Processing + Tutorials
Fundamental Image Processing Technologies; Tutorials on Key Lecture Notes
Lecture 12 -- Course Overview

Assessment

The assessment for this subject will consistent of:

assignment I covers lectures 1 - 7 (30%)
assignment II covers lectures 8 - 11 (30%)
3 hour final exam, it covers all lectures (40% in final exam weeks)

The assignments will be programming assignments closely related to the lectures. Details of the assignments will be provided in due time.

Late Penalties

Students are strongly advised to start early and do not wait until the last minute. Student will lose 2 marks out of 30 for each day that the assignment is later. Extensions will not be granted unless you have legitimate reasons and have let the LiC know ASAP, preferably one week before its due date.

Text Books

There is no set textbook. Lecture notes provide a sufficient coverage over all materials.

References

Ghanbari M, Video coding: an introduction to standard codecs, IEE Publishing, 1999.
Haskell B G, Puri A and Netravali A N, Digital video: an introduction to MPEG-2, Kluwer Academic Publishers, 1996.
Shi Y Q, Image and video compression for multimedia engineering, CRC Press, 2000. Electronic copy available through UNSW library.
Manjunath B S, Salembier P, Sikora T (ed), Introduction to MPEG-7, Multimedia Content Description Interface, John Wiley & Sons, Ltd, 2002.
Feng D, Siu W C and Zhang H J (ed), Multimedia Information Retrieval and Management, Springer, 2003.

RTSP www.ietf.org/rfc/rfc2326.txt
SDP www.ietf.org/rfc/rfc2327.txt
RTP www.ietf.org/rfc/rfc3550.txt
RTP for MPEG-4 www.ietf.org/rfc/rfc3016.txt
XML www.w3.org/TR/REC-xml/
SMIL www.w3.org/TR/smil20/

WARNING

Copying in assignments is unacceptable. Assignments will be checked. The penalties for copying range from receiving no marks for the assignment to complete failure of the subject.

Further details of the School plagiarism policy can be found here. (You acknowledged receipt of these rules when you obtained your CSE computer account, and the link above is for your convenience so that you can review the rules now.)

Continual Course Improvement

The CATEI evaluation from the last time we taught this course showed that students were almost satisfied with most of the aspects of the course. Thus we intend to maintain the similar style and key structure for the up-coming offering. In order to further improve our teaching quality, we will increase tutorial time and ensure that feedback is delivered in a timely fashion.

Futher Information

Students enrolled in COMP9519 are expected to attend all classes.
The use of School of Computer Science and Engineering computing laboratories is subject to rules described in the Yellow Form, which you acknowledge (electronic) receipt of when you receive your computing account. The Yellow Form also outlines what to do in case illness or misadventure that affects your assessment, and supplementary examinations procedures within the School of Computer Science and Engineering.
Information on UNSW Occupational Health and Safety policies and expectations
Equity and Diversity issues