CS5342: Multimedia Computing and Applications

Semester II, 2013-2014 (Wednesdays 6.30 pm - 8.30 pm, SR2 (COM1 #02-04))

Last update: Monday, 19-Jan-2015 17:30:15 SGT

Table of Contents

General Information

Lecturer: Mohan S Kankanhalli

Lectures: 26 Hours (Wednesdays, 6.30pm - 8.30pm, SR2 (COM1 #02-04))

Aims and Objectives:

This course lays the foundation for graduate students to build advanced multimedia computing applications comprising of images, videos, and audio. The module covers the important multimedia computing methods by presenting a comprehensive coverage of the underlying content processing, content transformation and resource optimization techniques in a variety of systems such as multimedia information retrieval, conferencing, surveillance and security. By considering the research issues in the multimedia systems areas, it will also prepare the student in formulating novel approaches for future multimedia computing applications.

Brief Description:

By the end of the course, the students will be familiar with the common computing fundamentals employed in a variety of multimedia applications such as: content-based multimedia retrieval, summarization, surveillance, multimedia security and computational advertisement. The students will be exposed to the core techniques and algorithms spanning across the common and emerging multimedia applications. They will have experience in applying these techniques to novel situations and will be able to do analytical as well as empirical performance evaluation of the particular technique in the overall application context.

Grading information:

Survey Paper: 20%
Assignment: 20%
Project: 60%


Office consultation hours:

<-- Table of Contents

Brief Course Outline

* Introduction to Multimedia Computing (2 hrs)
Motivation; Fundamentals of Multimedia Computing; Image, Video and Audio Compression Overview
* Content-based Retrieval (6 hrs)
   Image Retrieval; Video Retrival; Tagging
* Multimedia Content Processing (4 hrs)
   Multimodal Data Fusion; Visual Saliency & Experiential Sampling
* Multimedia Summarization (2 hrs)
   Video Summarization; Multimedia Simplification
* Multimedia Data Mining (2 hrs)
   Probabilitic Concepts; Image/Video Mining; Concept Mining
* Multimedia Surveillance (4 hrs)
   Background Modeling; Object Tracking; Use of Multiple Sensors; Decision-theoretic Methods
* Multimedia Security (2 hrs)
   Watermarking; Forensics
* Computational Multimedia Advertisement (2 hrs)
   Computational Advertisement Framework; Multimedia Analysis for Ad Placement
* Current Issues & Trends (2 hrs)

<-- Table of Contents

Course Material

There will be no textbook for this course. We will provide the supplementary material wherever necessary.
<-- Table of Contents

Assignment Information

<-- Table of Contents

Project Information

The details of the project will be posted here:

<-- Table of Contents

Class Schedule

15th Jan (Week 1): Lecture 1: Introduction to Multimedia Computing  

22nd Jan (Week 2): Lecture 2: Content Based Retrieval I  

29st Jan (Week 3): Lecture 3: Content Based Retrieval II 

5th Feb (Week 4): Lecture 4: Content-based Retrieval III 

12th Feb (Week 5): Lecture 5: Multimedia Content Processing I 

19th Feb (Week 6): Lecture 6: Multimedia Content Processing II  

26th Feb Semester Break

5th Mar (Week 7): Lecture 7: Multimedia Summarization  

12th Mar (Week 8): Lecture 8: Multimedia Data Mining  

19th Mar (Week 9): Lecture 9: Multimedia Security  

26th Mar (Week 10): Lecture 10: Multimedia Surveillance I  

2nd Mar (Week 11): Lecture 11: Multimedia Surveillance II  

9th Apr (Week 12): Lecture 12: Computational Multimedia Advertisement  

16th Apr (Week 13): Lecture 13: Current Issues & Trends  

<-- Table of Contents