CS5342: Multimedia Computing and Applications

Semester II, AY2015/2016 (Fridays 6.30 pm - 8.30 pm, SR2 (COM1 #02-04))

Last update: Friday, 18-Mar-2016 20:17:40 SGT

Table of Contents

General Information

Lecturer: Roger Zimmermann

Lectures: 26 Hours (Fridays, 6.30pm - 8.30pm, SR2 (COM1 #02-04))

Aims and Objectives:

This course lays the foundation for graduate students to build advanced multimedia computing applications comprising of images, videos, and audio. The module covers the important multimedia computing methods by presenting a comprehensive coverage of the underlying content processing, content transformation and resource optimization techniques in a variety of systems such as multimedia information retrieval, conferencing, surveillance and security. By considering the research issues in the multimedia systems areas, it will also prepare the student in formulating novel approaches for future multimedia computing applications.

Brief Description:

By the end of the course, the students will be familiar with the common computing fundamentals employed in a variety of multimedia applications such as: content-based multimedia retrieval, summarization, surveillance, multimedia security and computational advertisement. The students will be exposed to the core techniques and algorithms spanning across the common and emerging multimedia applications. They will have experience in applying these techniques to novel situations and will be able to do analytical as well as empirical performance evaluation of the particular technique in the overall application context.

Grading information:

Survey Paper: 20%
Assignment: 20%
Project: 60%

Teaching Assistant:


Office consultation hours:

<-- Table of Contents

Brief Course Outline

* Introduction to Multimedia Computing (2 hrs), [Slides]
Motivation; Fundamentals of Multimedia Computing; Image, Video and Audio Compression Overview
* Content-based Retrieval (6 hrs)
   Image Retrieval; Video Retrival; Tagging
* Multimedia Content Processing (4 hrs)
   Multimodal Data Fusion; Visual Saliency & Experiential Sampling
* Multimedia Surveillance (2 hrs)
   Background Modeling; Object Tracking; Use of Multiple Sensors; Decision-theoretic Methods
* Multimedia Summarization (2 hrs)
   Video Summarization; Multimedia Simplification
* Multimedia Data Mining (2 hrs)
   Probabilitic Concepts; Image/Video Mining; Concept Mining
* Multimedia Security (2 hrs)
   Watermarking; Forensics
* Computational Multimedia Advertisement (2 hrs)
   Computational Advertisement Framework; Multimedia Analysis for Ad Placement
* Current Issues & Trends (2 hrs)

<-- Table of Contents

Course Material

There will be no textbook for this course. We will provide the supplementary material wherever necessary.
<-- Table of Contents

Assignment Information

<-- Table of Contents

Project Information

The details of the project will be posted here:

To give you some ideas, past projects have included the following (titles):

<-- Table of Contents

Class Schedule

15th Jan (Week 1): Lecture 1: Introduction to Multimedia Computing  

22rd Jan (Week 2): Lecture 2: Content Based Retrieval I  

29th Jan (Week 3): Lecture 3: Content Based Retrieval II 

5th Feb (Week 4): Lecture 4: Content-based Retrieval III 

12th Feb (Week 5 - Lunar New Year): Lecture 5: Multimedia Content Processing I 

19th Feb (Week 6): Lecture 6: Multimedia Content Processing II  

26th Feb (Recess Week - Semester Break)

4th Mar (Week 7): Lecture 7: Multimedia Surveillance I  

11th Mar (Week 8): Lecture 8: Multimedia Summarization  

18th Mar (Week 9): Lecture 9: Multimedia Data Mining  

25th Mar (Week 10 - Good Friday - No Lecture)  

1st Apr (Week 11) Lecture 9: Multimedia Security  

8th Apr (Week 12): Lecture 11: Computational Multimedia Advertisement  

15th Apr (Week 13): Lecture 12: Current Issues & Trends  

<-- Table of Contents