Course-specific information: limited participants

Due to the format of the course, there is a limit on the number of participants. It is mandatory to register for this course in advance; only enrollment for the lectures (in uSis/MyStudyMap) will count. Participation for students following the ACS master track is guaranteed, but they must register in advance to secure their place. At the beginning of the semester, we will determine if there is spare capacity for students who follow other programs and admit additional students on a first-come-first-serve basis.

(1) [Sept 4, after the teacher gives the join code in class] Create a login on the LML Course Manager: https://orion.liacs.nl and then
(2) Register for Course: Multimedia Systems

Period: Sept. 4 - Dec. 4 (tentative)
Time: Lectures 15:15- starting in Gorlaeus Building - BW.0.40
Place: see MyTimeTable

- See Leiden StudyGids website and MyTimeTable

Organizers:

Prof. dr. Michael Lew, (Lecturer) email: lewmscourse@gmail.com (Email to make an appointment)

Dr Erwin M. Bakker, (Lecturer) email: erwin@liacs.nl

Christos Damianidis, c.damianidis@umail.leidenuniv.nl (Teaching Assistant)

Ahmed El-Hage, ahmadelhage03@gmail.com (Teaching Assistant)

      Students: In emails, please use subject lines which start with MS: (e.g. MS: Help on project)

Goals

At the end of the Multimedia Systems course, the student should be able to

- understand how scientific researchers view multimedia systems
- have insight into the state-of-the-art in the prominent areas of scientific multimedia research including social computing, advanced Internet technologies, speech recognition, robotics, computer vision, video tracking, and biometrics
- have insight into building a multimedia system from diverse core technologies.
- have insight into the challenges and limitations of current multimedia systems
- scientifically evaluate a multimedia system
- build a prototype multimedia system

Description:

Multimedia systems is a wide and diverse area. In this course we focus on the scientific view of multimedia systems as presented in major conferences and journals. The intention is to focus on current research trends such as social computing, speech recognition, robotics, and computer vision and gain insight into what is novel from a modern scientific perspective. From a practical standpoint, the technologies may be areas where the student will do further research, take in-depth courses in the specific area (i.e. Speech Understanding) or be used as components for future multimedia systems.

This is a masters level course, where instead of having only lectures and an exam, we have a combination of lectures and student presentations and novel programming projects. Two projects which emphasize the students vision on future multimedia technologies are mandatory: (1) In the future vision video project, the student is expected to show their own vision on how multimedia technology will effect society in the future. (2) In the final project, the students create a working prototype of a novel multimedia system based on thier own vision and interests. In summary, we show you the diverse landscape of multimedia technology as a broad foundation, and based on that foundation you develop your own interests and vision. This year, we will discuss the following topics in multimedia systems: speech recognition, social computing, robotics, vision & machine learning (OpenCV, CUDA), video understanding & retrieval, and biometrics & face recognition.

There are workshops and project discussions during the semester, which are meant to provide reinforcement, practical experience, feedback and advice for each student’s application. Late submissions are always penalized and may not be submitted 2 days or more after the deadline. For every assignment, to receive credit, each student must submit their own answer whether they are working alone or in teams (2 people on a team means 2 submissions). Class discussion is important and is included as part of the grade.

Prerequisites: The student should be fluent in C/C++ programming (Equivalent of 6 months programming experience in C or C++)

Examination (6 EC):
- Multimedia Project: Design & Programming & Documentation for your multimedia system (60% of grade).
- Future Vision Project (10% of grade): Create a short video of the future.
- Class discussions, attendance/participation (you should be at every class), homework, and problem sets (30% of grade).

Table of contents/Topics

- Introduction to multimedia systems
- Important areas of scientific multimedia research
- Challenges in scientific multimedia research
- Social computing
- Collaborative filtering
- Advanced internet technologies
- Speech recognition and audio analysis
- Robotics
- Planning
- Computer vision
- Video analysis and tracking
- Biometrics

Schedule (tentative)

Each lecture is meant to be a blend of past, present, and future trends

Sep 04 - Course Introduction & Group Discussion (Michael)

Sep 11 - Social Computing I, Group Discussion, C/C++ Programming Assignment (Michael)

Sep 18 - tba (Michael)

Sep 25 - Project Discussions (Michael, Erwin)

Oct 02 - tba

Oct 09 - Future Vision Expo (Michael, Erwin)

Oct 16 - Speech Recognition (Erwin)

Oct 23 - Speech Recognition Workshop (Erwin)

Oct 30 - Project Progress and Direction (Michael, Erwin)

Nov 06 - Robotics (Erwin)

Nov 13 - Robotics Workshop (Erwin)

Nov 20 - Visual Learning (Michael, BE.0.17)

Nov 27 - no class - work on Final Projects

Dec 04 - Project Expo (Erwin, Michael, BW.0.40)