COMP9519: Multimedia Systems

Prerequisite: COMP2011 or COMP2711 or COMP9024. Must have completed 12 UOC of level 3 or above courses.

Lecturers: A/Prof Jian Zhang (Lecturer-in-Charge), Dr. Jing Chen and Mr. Reji Mathew

Lectures: S2 2008 Thur 6-9 PM Room: Law 162, The Law Building, UNSW

Consultation: Wed 3-4 PM Level 4 UNSW L5 Building (NICTA) (from Week2)

UOC: 6

Parallel Teching

This course may be taken both by postgraduate students and senior undergraduate students

Learning Outcomes

Multimedia systems covers the key principles, techniques and applications of multimedia technology. Students who complete this course will have experience with

Basic concepts of image/video coding technology and compression standards

Basic concepts of internet streaming media

Fundamentals of multimedia content description and presentation

fundamentals of content based image and video retrieval techniques

Basic knowledge of multimedia database system -- indexing, browsing and retrieval

and familiarity at an introductory level with examples of audio, image and video processing techniques in multimedia systems. After learning this course, it would be a significant step for students either to pursuer academic post-graduate study or to join industrial R/D organizations.

Course Outlines

Recommended References

Policy on Copying Assignments

Continual Course Improvement

Subject Contents

Lecture 1 -- Introduction & Image and Video Coding Techniques (I) (Jian Zhang)
Multimedia Applications; Introduction to Multimedia Research; Basic Concepts in Multimedia Signal Processing; Spatial Redundancy in Images; Lossless & Predictive Coding (entropy coding); Introduction to Image Quantization (Jian Zhang)
Lecture 2 -- Image and Video Coding Techniques (II) (Jian Zhang)
Transform coding; Still Image Coding Standard (JPEG); Subband Coding; Temporal Redundancy & Temporal Predictive Coding for Video; Motion Estimation & Compensation
Lecture 3 -- Video Compression Standards (part 1) (Jian Zhang)
Human Visual System (HVS) Characteristics; Digital Video Coding (DVC) Structure; Digital Video Coding standards: ITU-T H.261, ISO/IEC MPEG-1 & MPEG-2
Lecture 4 -- Video Compression Standards (part 2) (Jian Zhang)
MEPG-2 Error Resilience/Error Concealment; Introduction to MPEG-4 Video Standard; Introduction to JVC (IUT-T&MPEG) H.264
Lecture 5 -- Internet Streaming Media (Reji Mathew)
Internet Streaming Media Architecture: Client / Server Architecture; Issues of Real-time Delivery - delay, packet loss, error resilience, QoS; Real-time Data Transport: Real-time Transport Protocol (RTP); Control Protocol / QoS Feedback (RTCP); Example - RTP Payload format for MPEG-4
Lecture 6 -- Multimedia Presentation (Reji Mathew)
Session Description Protocol (SDP), Real Time Streaming Protocol - "internet VCR controls", Inter-media synchronization; File Formats: Multimedia File Formats - requirements and features; Example MP4
Lecture 7 -- Multimedia Content Description (part 1) (Reji Mathew)
Need for Meta Data to Describe Content; Goals of MPEG-7 - Multimedia Content Description Interface; MPEG-7 Description Schemes for Content Management: Information on Creation and Production of Media Content; Description of Compression, Profile, Storage Format of Content
Lecture 8 -- Multimedia Content Description (part 2) (Jing Chen)
Content Descriptors and Feature Extraction for Colour, Shape and Texture
Lecture 9 -- Multimedia Content Description (part 3) (Jing Chen)
Motion Descriptors, Content Based Image Retrieval
Lecture 10 -- Multimedia Signal Processing + Tutorials (Jing Chen, Reji Mathew and Jian Zhang)
Assignment 1 review, Assignment 2 introduction; Fundamental Image Processing Technologies; Tutorials on Key Lecture Notes
Lecture 11 -- Video Structure, Representation, Mining and Retrieval System (Jing Chen)
Video Content Representation: Video Summarization and Browsing; Concepts of Video Retrieval; Query Specification & Similarity Measures; Content based Data Ming & Retrieval System; Applications
Lecture 12 -- Course Overview (Jian Zhang, Jing Chen and Reji Mathew)

Assessment

The assessment for this subject will consistent of:

assignment I covers lectures 1 - 7 (30% set by Jian Zhang & Reji Mathew)
assignment II covers lectures 8 - 11 (30% set by Jing Chen)
3 hour final exam, it covers all lectures (40% set by Jian Zhang, Jing Chen and Reji Mathew in UNSW final exam weeks)

The assignments will be programming assignments closely related to the lectures. Details of the assignments will be provided in due time.

Late Penalties

Students are strongly advised to start early and do not wait until the last minute. Student will lose 2 marks out of 30 for each day that the assignment is later. Extensions will not be granted unless you have legitimate reasons and have let the LiC know ASAP, preferably one week before its due date.

Text Books

There is no set textbook. Lecture notes provide a sufficient coverage over all materials.

References

Ghanbari M, Video coding: an introduction to standard codecs, IEE Publishing, 1999.
Haskell B G, Puri A and Netravali A N, Digital video: an introduction to MPEG-2, Kluwer Academic Publishers, 1996.
Shi Y Q, Image and video compression for multimedia engineering, CRC Press, 2000. Electronic copy available through UNSW library.
Manjunath B S, Salembier P, Sikora T (ed), Introduction to MPEG-7, Multimedia Content Description Interface, John Wiley & Sons, Ltd, 2002.
Feng D, Siu W C and Zhang H J (ed), Multimedia Information Retrieval and Management, Springer, 2003.

RTSP www.ietf.org/rfc/rfc2326.txt
SDP www.ietf.org/rfc/rfc2327.txt
RTP www.ietf.org/rfc/rfc3550.txt
RTP for MPEG-4 www.ietf.org/rfc/rfc3016.txt
XML www.w3.org/TR/REC-xml/
SMIL www.w3.org/TR/smil20/

WARNING

Copying in assignments is unacceptable. Assignments will be checked. The penalties for copying range from receiving no marks for the assignment to complete failure of the subject.

Further details of the School plagiarism policy can be found here. (You acknowledged receipt of these rules when you obtained your CSE computer account, and the link above is for your convenience so that you can review the rules now.)

Continual Course Improvement

The CATEI evaluation from the last time we taught this course showed that students were almost satisfied with most of the aspects of the course. Thus we intend to maintain the similar style and key structure for the up-coming offering. In order to further improve our teaching quality, we will increase tutorial time and ensure that feedback is delivered in a timely fashion.

Futher Information

Students enrolled in COMP9519 are expected to attend all classes.
The use of School of Computer Science and Engineering computing laboratories is subject to rules described in the Yellow Form, which you acknowledge (electronic) receipt of when you receive your computing account. The Yellow Form also outlines what to do in case illness or misadventure that affects your assessment, and supplementary examinations procedures within the School of Computer Science and Engineering.
Information on UNSW Occupational Health and Safety policies and expectations
Equity and Diversity issues