Semester II, 2011-2012 (Mondays 6.30 pm - 8.30 pm, SR at LT19 (adjacent to LT19))

Last update: Friday, 09-Mar-2012 18:12:34 SGT

Table of Contents

• Announcements (last updated 18-02-2012)
• General Information
• Brief Course Outline
• Course Material
• Assignment Information
• Project Information
• Class Schedule

General Information

Lecturer: Mohan S Kankanhalli Chua Tat-Seng

Aims and Objectives:

This course lays the foundation for graduate students to build advanced multimedia computing applications comprising of images, videos, and audio. The module covers the important multimedia computing methods by presenting a comprehensive coverage of the underlying content processing, content transformation and resource optimization techniques in a variety of systems such as multimedia information retrieval, conferencing, surveillance and security. By considering the research issues in the multimedia systems areas, it will also prepare the student in formulating novel approaches for future multimedia computing applications.

Brief Description:

By the end of the course, the students will be familiar with the common computing fundamentals employed in a variety of multimedia applications such as: content-based multimedia retrieval, summarization, surveillance, multimedia security and computational advertisement. The students will be exposed to the core techniques and algorithms spanning across the common and emerging multimedia applications. They will have experience in applying these techniques to novel situations and will be able to do analytical as well as empirical performance evaluation of the particular technique in the overall application context.

Grading information:

Survey Paper: 25%
Assignment: 25%
Project: 50%

Pre-requisites:

• Required: CS4241 Multimedia Information Retrieval
• Desirable: CS5240 Theoretical Foundations of Multimedia

Office consultation hours:

• Mohan Kankanhalli   (by appointment)
• Chua Tat-Seng   (by appointment)

<-- Table of Contents

Brief Course Outline

* Introduction to Multimedia Computing (2 hrs)
   Motivation; Fundamentals of Multimedia Computing; Image, Video and Audio Compression Overview;
* Intro to Information Retrieval (2 hrs)
   Boolean and Vector Space Models; Relevance Feedback; Latent Semantic Analysis;
* Content-based Retrieval (8 hrs)
   Image Retrieval; Video Retrieval; Audio retrieval; Tagging;
* Multimedia Content Processing (4 hrs)
   Multimodal Data Fusion; Visual Attention & Experiential Sampling;
* Multimedia Summarization (2 hrs)
   Video Summarization; Multimedia Simplification
* Multimedia Surveillance (2 hrs)
   Background Modeling; Object Tracking; Use of Multiple Sensors
* Multimedia Security (2 hrs)
   Watermarking; Forensics;
* Computational Multimedia Advertisement (2 hrs)
   Computational Advertisement Framework; Multimedia Analysis for Ad Placement;
* Current Issues & Trends (2 hrs)

<-- Table of Contents

Course Material

<-- Table of Contents

Assignment Information

• Survey Paper is due on Monday, January 30, 2012.
• Assignment is due on Monday, February 27, 2012.

<-- Table of Contents

Project Information

The details of the project will be posted here:

• Project proposal is due on Friday, February 3, 2012.
• The interim project report is due on Friday, March 2, 2012.
• The final project submission is due on Monday, April 9, 2012.

<-- Table of Contents

Class Schedule

9^th Jan (Week 1): Lectures 0 & 1: Introduction to Multimedia Computing   [MSK]

• Reading: Wallace's JPEG Tutorial; MPEG Overview; MPEG Paper; MP3 Tutorial.

16^th Jan (Week 2): Lecture 2: Intro to Information Retrieval   [CTS]

• Reading: Latent Semantic Analysis.

21^st Jan (Week 3): Lecture 3: Multimedia Content Processing I  [MSK] 11.00am - 1.00pm SR at LT19   Note: This is a Saturday make-up class for January 23^rd

• Reading: Information Assimilation Framework for Event Detection in Multimedia Surveillance Systems, Multimodal Fusion for Multimedia Analysis: A Survey.

30^th Jan (Week 4): Lecture 4: Content-based Retrieval I  [CTS]

• Reading: Content-based Image Retrieval at the End of the Early Years; Application Potential of Multimedia Information Retrieval.

6^th Feb (Week 5): Lecture 5: Multimedia Content Processing II  [MSK]

• Reading: Experiential Sampling in Multimedia Systems.

13^th Feb (Week 6): Lecture 6: Content Based Retrieval II   [CTS]

• Reading: Applications of Video Content-Analysis and Retrieval.

20^th Feb Semester Break

27^th Feb (Week 7): Lecture 7: Multimedia Summarization   [MSK] 4.30pm - 6.30pm SR5 at COM1 #02-01   Note: Changed Timing and Venue

• Reading: Video Summarization using R-Sequences; Compressed Domain Video Summarization; Semantic Video Summarization; Multimedia Simplification.

5^th Mar (Week 8): Lecture 8: Content-based Retrieval III   [CTS]

• Reading: Automatic Image Annotation and Retrieval using Cross-Media Relevance Models.

12^th Mar (Week 9): Lecture 9: Multimedia Surveillance   [MSK]

• Reading: Adaptive Background Mixture Models for Real-time Tracking. Tracking Paper, Tracking with Kalman Filtering

19^th Mar (Week 10): Lecture 10: Content Based Retrieval IV   [CTS]

• Reading: Melody Curve Processing for Music Retrieval.

26^th Mar (Week 11): Lecture 11: Multimedia Security   [MSK]

• Reading: Content-based Watermarking of Images, Compressed Domain Scrambler/Descrambler for Digital Video.

2^nd Apr (Week 12): Lecture 12: Computational Multimedia Advertisement   [MSK]

• Reading:

9^th Apr (Week 13): Lecture 13: Current Issues & Trends   [MSK, CTS]

<-- Table of Contents