Semester I, 2009-2010 (Mondays 6.30 pm - 8.30 pm, SR3 (COM1 02-12))

Last update: Monday, 09-Nov-2009 18:17:22 SGT

Table of Contents

• Announcements (last updated 15-08-2009)
• General Information
• Brief Course Outline
• Course Material
• Assignment Information
• Project Information
• Class Schedule

General Information

Lecturer: Mohan S Kankanhalli

Aims and Objectives:

This course lays the foundation for graduate students to build advanced multimedia computing applications comprising of images, videos, and audio. The module covers the important multimedia computing methods by presenting a comprehensive coverage of the underlying content processing, content transformation and resource optimization techniques in a variety of systems such as multimedia information retrieval, conferencing, surveillance and security. By considering the research issues in the multimedia systems areas, it will also prepare the student in formulating novel approaches for future multimedia computing applications.

Brief Description:

By the end of the course, the students will be familiar with the common computing fundamentals employed in a variety of multimedia applications such as: content-based multimedia retrieval, summarization, surveillance and multimedia security. The students will be exposed to the core techniques and algorithms spanning across the common and emerging multimedia applications. They will have experience in applying these techniques to novel situations and will be able to do analytical as well as empirical performance evaluation of the particular technique in the overall application context.

Grading information:

Midterm Exam: 20% [open book]
Two Assignments: 40%
Project: 40%

Pre-requisites:

• Required: Equivalent of CS4341 Multimedia Technologies
• Desirable: Knowledge of CS5240 Theoretical Foundations of Multimedia

Office consultation hours:

• Mohan Kankanhalli Mon 4pm - 6pm (AS6 #05-06)

<-- Table of Contents

Brief Course Outline

* Introduction to Multimedia Computing (2 hrs)
   Motivation; Fundamentals of Multimedia Computing; Image, Video and Audio Compression Overview;
* Intro to Information Retrieval (2 hrs)
   Boolean and Vector Space Models; Relevance Feedback; Latent Semantic Analysis;
* Content-based Retrieval (8 hrs)
   Image Retrieval; Video Retrieval; Audio retrieval; Tagging;
* Multimedia Content Processing (4 hrs)
   Multimodal Data Fusion; Visual Attention & Experiential Sampling;
* Multimedia Summarization (2 hrs)
   Video Summarization; Multimedia Simplification
* Multimedia Surveillance (4 hrs)
   Background Modeling; Object Tracking; Use of Multiple Sensors
* Multimedia Security (2 hrs)
   Watermarking; Forensics;
* Current Issues & Trends (2 hrs)

<-- Table of Contents

Course Material

<-- Table of Contents

Assignment Information

• Assignment 1 is due on Friday, September 11, 2009.
• Assignment 2 is due on Friday, October 16, 2009.

<-- Table of Contents

Project Information

The details of the project will be posted here:

• Project proposal is due on Friday, September 4, 2009.
• The interim project report is due on Friday, October 9, 2009.
• The final project submission is due on Monday, November 19, 2009.

<-- Table of Contents

Class Schedule

3^rd Aug (Week 0): Lecture 0: Course Organization and Logistics   Note: No class so please read the online material (in one slide on one page and four slides on one page formats)

• Reading: Lecture 0 slides

8^th Aug (Week 1): Lecture 1: Introduction to Multimedia Computing     9.00am - 11.00am @ SR3 (COM1 02-12)   Note: make-up class for August 10^th

• Reading: Wallace's JPEG Tutorial; MPEG Overview; MPEG Paper; MP3 Tutorial.

17^th Aug (Week 2): Lecture 2: Intro to Information Retrieval

• Reading:

24^th Aug (Week 3): Lecture 3: Content-based Retrieval I

• Reading: Content-based Image Retrieval at the End of the Early Years.

29^th Aug (Week 4): Lecture 4: Content Based Retrieval II     9.00am - 11.00am @ SR2 (COM1 02-04)   Note: make-up class for August 31^st

• Reading: Applications of Video Content-Analysis and Retrieval.

7^th Sep (Week 5): Lecture 5: Content Based Retrieval III

• Reading: Melody Curve Processing for Music Retrieval.

14^th Sep (Week 6): Lecture 6: Content-based Retrieval IV

• Reading: Automatic Image Annotation and Retrieval using Cross-Media Relevance Models.

21^st Sep Semester Break

28^th Sep (Week 7): Lecture 7: Multimedia Content Processing I     Note: Mid-Term Exam will be conducted just before the class   5.00pm - 6.00pm @ SR1 (COM1 02-06)

• Reading: Information Assimilation Framework for Event Detection in Multimedia Surveillance Systems.

5^th Oct (Week 8): Lecture 8: Multimedia Content Processing II

• Reading: Experiential Sampling in Multimedia Systems.

12^th Oct (Week 9): Lecture 9: Multimedia Summarization

• Reading: Video Summarization using R-Sequences; Compressed Domain Video Summarization; Semantic Video Summarization; Multimedia Simplification.

19^th Oct (Week 10): Lecture 10: Multimedia Surveillance I

• Reading: Adaptive Background Mixture Models for Real-time Tracking.

26^th Oct (Week 11): Lecture 11: Multimedia Surveillance II

• Reading: Tracking Paper, Tracking with Kalman Filtering, A Design Methodology for Sensor Selection and Placement

2^nd Nov (Week 12): Lecture 12: Multimedia Security

• Reading: Content-based Watermarking of Images, Compressed Domain Scrambler/Descrambler for Digital Video.

9^th Nov (Week 13): Lecture 13: Current Issues & Trends  

<-- Table of Contents