CS5342: Multimedia Computing and Applications

Semester II, 2014-2015 (Fridays 6.30 pm - 8.30 pm, SR2 (COM1 #02-04))

Last update: Friday, 27-Mar-2015 14:19:04 SGT


Table of Contents



General Information

Lecturer: Roger Zimmermann

Lectures: 26 Hours (Fridays, 6.30pm - 8.30pm, SR2 (COM1 #02-04))

Aims and Objectives:

This course lays the foundation for graduate students to build advanced multimedia computing applications comprising of images, videos, and audio. The module covers the important multimedia computing methods by presenting a comprehensive coverage of the underlying content processing, content transformation and resource optimization techniques in a variety of systems such as multimedia information retrieval, conferencing, surveillance and security. By considering the research issues in the multimedia systems areas, it will also prepare the student in formulating novel approaches for future multimedia computing applications.

Brief Description:

By the end of the course, the students will be familiar with the common computing fundamentals employed in a variety of multimedia applications such as: content-based multimedia retrieval, summarization, surveillance, multimedia security and computational advertisement. The students will be exposed to the core techniques and algorithms spanning across the common and emerging multimedia applications. They will have experience in applying these techniques to novel situations and will be able to do analytical as well as empirical performance evaluation of the particular technique in the overall application context.

Grading information:

Survey Paper: 20%
Assignment: 20%
Project: 60%

Pre-requisites:

Office consultation hours:

<-- Table of Contents


Brief Course Outline

* Introduction to Multimedia Computing (2 hrs)
  
Motivation; Fundamentals of Multimedia Computing; Image, Video and Audio Compression Overview
* Content-based Retrieval (6 hrs)
   Image Retrieval; Video Retrival; Tagging
* Multimedia Content Processing (4 hrs)
   Multimodal Data Fusion; Visual Saliency & Experiential Sampling
* Multimedia Summarization (2 hrs)
   Video Summarization; Multimedia Simplification
* Multimedia Data Mining (2 hrs)
   Probabilitic Concepts; Image/Video Mining; Concept Mining
* Multimedia Streaming (2 hrs)
   Streaming protocols; MPEG-DASH; WebRTC
* Multimedia Surveillance (2 hrs)
   Background Modeling; Object Tracking; Use of Multiple Sensors; Decision-theoretic Methods
* Multimedia Security (2 hrs)
   Watermarking; Forensics
* Computational Multimedia Advertisement (2 hrs)
   Computational Advertisement Framework; Multimedia Analysis for Ad Placement
* Current Issues & Trends (2 hrs)

<-- Table of Contents


Course Material

There will be no textbook for this course. We will provide the supplementary material wherever necessary.
<-- Table of Contents


Assignment Information

<-- Table of Contents


Project Information

The details of the project will be posted here:

<-- Table of Contents


Class Schedule

16th Jan (Week 1): Lecture 1: Introduction to Multimedia Computing  

23rd Jan (Week 2): Lecture 2: Content Based Retrieval I  

30th Jan (Week 3): Lecture 3: Content Based Retrieval II 

6th Feb (Week 4): Lecture 4: Content-based Retrieval III 

13th Feb (Week 5): Lecture 5: Multimedia Content Processing I 

20th Feb (Week 6 - Lunar New Year): Lecture 6: Multimedia Content Processing II  

27th Feb Recess Week - Semester Break

6th Mar (Week 7): Lecture 7: Multimedia Summarization  

13th Mar (Week 8 - eLearning): Lecture 8: Multimedia Data Mining  

20th Mar (Week 9 - No Lecture): Lecture 9: Multimedia Security  

27th Mar (Week 10): Lecture 10: Multimedia Streaming  

3rd Apr (Week 11 - Good Friday): Lecture 11: Multimedia Surveillance I  

10th Apr (Week 12): Lecture 12: Computational Multimedia Advertisement  

17th Apr (Week 13): Lecture 13: Current Issues & Trends  

<-- Table of Contents