COMP9519: Multimedia Systems
Prerequisite: COMP2011 or COMP2711 or COMP9024. Must have completed 12 UOC of level 3 or above courses.
Lecturers:
A/Prof Jian Zhang (Lecturer-in-Charge), Dr. Jing Chen and Mr. Reji Mathew
Lectures: S2 2008 Thur 6-9 PM Room: Law 162, The Law Building, UNSW
Consultation: Wed 3-4 PM Level 4 UNSW L5 Building (NICTA) (from Week2)
UOC: 6
Parallel Teching
This course may be taken both by postgraduate students and senior undergraduate students
Learning Outcomes
Multimedia systems covers the key principles, techniques and applications of
multimedia technology. Students who complete this course will have experience with
Basic concepts of image/video coding technology and compression standards
Basic concepts of internet streaming media
Fundamentals of multimedia content description and presentation
fundamentals of content based image and video retrieval techniques
Basic knowledge of multimedia database system -- indexing, browsing and retrieval
and familiarity at an introductory level with examples of audio, image and video processing techniques in multimedia systems. After learning this course, it would be a significant step for students either to pursuer academic post-graduate study or to join industrial R/D organizations.
Course Outlines
Subject Content
Assessment
Late Penalties
Text Book
Recommended References
Policy on Copying Assignments
Continual Course Improvement
Further Information
Assignments
Lecture Notes
Contacts
Subject Contents
- Lecture 1 -- Introduction & Image and Video Coding Techniques
(I) (Jian Zhang)
Multimedia Applications; Introduction to Multimedia Research; Basic
Concepts in Multimedia Signal Processing;
Spatial Redundancy in Images; Lossless & Predictive Coding (entropy coding); Introduction to Image Quantization (Jian Zhang)
- Lecture 2 -- Image and Video Coding Techniques (II) (Jian
Zhang)
Transform coding; Still Image Coding Standard (JPEG); Subband Coding; Temporal Redundancy & Temporal Predictive Coding for Video; Motion
Estimation & Compensation
- Lecture 3 -- Video Compression Standards (part 1) (Jian
Zhang)
Human Visual System (HVS) Characteristics; Digital Video Coding (DVC) Structure; Digital Video Coding
standards: ITU-T H.261, ISO/IEC MPEG-1 & MPEG-2
- Lecture 4 -- Video Compression Standards (part 2) (Jian
Zhang)
MEPG-2 Error Resilience/Error Concealment; Introduction to MPEG-4 Video Standard; Introduction to JVC (IUT-T&MPEG) H.264
- Lecture 5 -- Internet Streaming Media (Reji Mathew)
Internet Streaming Media Architecture: Client / Server Architecture; Issues of Real-time Delivery - delay, packet loss, error resilience,
QoS; Real-time Data Transport: Real-time Transport Protocol (RTP); Control Protocol / QoS Feedback (RTCP); Example - RTP Payload format for
MPEG-4
- Lecture 6 -- Multimedia Presentation (Reji Mathew)
Session Description Protocol (SDP), Real Time Streaming Protocol - "internet VCR controls", Inter-media synchronization; File Formats: Multimedia File Formats - requirements and features; Example MP4
- Lecture 7 -- Multimedia Content Description (part 1) (Reji
Mathew)
Need for Meta Data to Describe Content; Goals of MPEG-7 - Multimedia Content Description Interface;
MPEG-7 Description Schemes for Content Management: Information on Creation and Production of Media Content;
Description of Compression, Profile, Storage Format of Content
- Lecture 8 -- Multimedia Content Description (part 2) (Jing
Chen)
Content Descriptors and Feature Extraction for Colour, Shape and
Texture
- Lecture 9 -- Multimedia Content Description (part 3) (Jing
Chen)
Motion Descriptors, Content Based Image Retrieval
- Lecture 10 -- Multimedia Signal Processing + Tutorials (Jing Chen,
Reji Mathew and Jian Zhang)
Assignment 1 review, Assignment 2 introduction; Fundamental Image
Processing Technologies; Tutorials on Key Lecture Notes
- Lecture 11 -- Video Structure, Representation, Mining and
Retrieval System (Jing
Chen)
Video Content Representation: Video Summarization and Browsing; Concepts
of Video Retrieval; Query Specification & Similarity Measures; Content based Data Ming &
Retrieval System; Applications
- Lecture 12 -- Course Overview (Jian Zhang, Jing Chen and Reji
Mathew)
Assessment
The assessment for this subject will consistent of:
- assignment I covers lectures 1 - 7 (30% set by Jian Zhang & Reji
Mathew)
- assignment II covers lectures 8 - 11 (30% set by Jing Chen)
- 3 hour final exam, it covers all lectures (40% set by Jian Zhang,
Jing Chen and Reji Mathew in UNSW final exam weeks)
The assignments will be programming assignments closely related to the lectures. Details of the assignments will be provided in due time.
Late Penalties
Students are strongly advised to start early and do not wait until the last minute. Student will lose 2 marks out of 30 for each day that the assignment is later. Extensions will not be granted unless you have legitimate reasons and have let the LiC know ASAP, preferably one week before its due date.
Text Books
There is no set textbook. Lecture notes provide a sufficient coverage
over all materials.
References
- Ghanbari M, Video coding: an introduction to standard codecs, IEE Publishing, 1999.
- Haskell B G, Puri A and Netravali A N, Digital video: an introduction to MPEG-2, Kluwer Academic Publishers, 1996.
- Shi Y Q, Image and video compression for multimedia engineering, CRC Press, 2000. Electronic copy available through UNSW library.
- Manjunath B S, Salembier P, Sikora T (ed), Introduction to MPEG-7, Multimedia Content Description Interface, John Wiley & Sons, Ltd, 2002.
- Feng D, Siu W C and Zhang H J (ed), Multimedia Information Retrieval and Management, Springer, 2003.
International Standards:
- RTSP www.ietf.org/rfc/rfc2326.txt
- SDP www.ietf.org/rfc/rfc2327.txt
- RTP www.ietf.org/rfc/rfc3550.txt
- RTP for MPEG-4 www.ietf.org/rfc/rfc3016.txt
- XML www.w3.org/TR/REC-xml/
- SMIL www.w3.org/TR/smil20/
WARNING
Copying in assignments is unacceptable. Assignments will be checked. The
penalties for copying range from receiving no marks for the assignment to
complete failure of the subject.
Further details of the School plagiarism policy can be found
here.
(You acknowledged receipt of these rules when you obtained your CSE computer
account, and the link above is for your convenience so that you can review
the rules now.)
Continual Course Improvement
The CATEI evaluation from the last time we taught this course showed that students were almost satisfied with most of the aspects of the course. Thus we intend to maintain the similar style and key structure for the up-coming offering. In order to further improve our teaching quality, we will increase tutorial time and ensure that feedback is delivered in a timely fashion.
Futher Information
- Students enrolled in COMP9519 are expected to attend all classes.
- The use of School of Computer Science and Engineering computing
laboratories is subject to rules described in the
Yellow Form, which you acknowledge (electronic) receipt of
when you receive your computing account. The Yellow Form also
outlines what to do in case illness or misadventure that affects
your assessment, and supplementary examinations procedures within
the School of Computer Science and Engineering.
- Information on
UNSW Occupational Health and Safety policies and expectations
- Equity and
Diversity issues
Assignments
Assignment
1 S2 2008
Assignment
2 S2 2008
Lecture 1
Lecture 1 4in1
Lecture 2
Lecture 2 4in1
Lecture 3
Lecture 3 4in1
Lecture 4
Lecture 4 4in1
Lecture 5
Lecture 5 4in1
Lecture 6
Lecture 6 4in1
Question For Lecture 5&6
Lecture 7
Lecture 7 4in1
Lecture 8
Lecture 8 4in1
Lecture 9
Lecture 9 4in1
Lecture 10
Lecture 10 4in1
Lecture 11
Lecture 11 4in1
Final Review Part
1
Final Review Part
1 4in1
Final
Review Part 2
Final
Review Part 2 4in1
Final Review Part
3
Final Review Part
3 4in1
Dr. Jian Zhang -- General enquiries, Lectures 1-4 and Assignment 1
jzhang@cse.unsw.edu.au
Room E308, UNSW L5 Building (NICTA)
Ph: 83060780
Mr Reji Mathew -- Lectures 5-7
reji@student.unsw.edu.au
Dr. Jing Chen -- Lectures 8-11 and Assignment 2
jing.chen@nicta.com.au
Room E318, UNSW L5 Building (NICTA)
Ph: 83060441
Page maintained by
jzhang@cse.unsw.edu.au
... Last modified on 15 July 2008