Multimodal Interfaces 2014
Teachers:
Antonio Camurri, DIBRIS, UniGE
Gualtiero Volpe, DIBRIS, UniGE
Paolo Coletta, Simone Ghisio, Simone Piana, Casa Paganini - InfoMus Research Centre, DIBRIS, UniGE
Period:
September, 1-3, 2014
Location:
Casa Paganini - InfoMus Research Centre (www.casapaganini.org)
Number of hours:
20
Summary:
This class focuses on the foundational elements of multimodal interfaces, i.e., human-computer interfaces that analyse and fuse information from different sensory channels (auditory, visual, gestural). The goal is to provide guidelines on the design and development of multimodal interfaces for several kinds of application scenarios, e.g., museum and cultural applications, performing arts, edutainment, entertainment, therapy and rehabilitation, and mobiles. Lectures will cover the following major topics: introduction to multimodal interfaces, analysis of human full-body movement and expressive gesture, affective computing and non verbal social interaction, sonic design and sound and music computing.
The course includes the presentation of EU ICT projects on multimodal interfaces (FET ILHAIRE, ASC INCLUSION, FET SIEMPRE, MIROR) and on the EU Culture MetaBody project, and practical sessions for the development of setups for scientific experiments and sample multimodal interfaces, using the EyesWeb XMI software platform (http://www.infomus.org/eyesweb_eng.php).
Prerequisites:
Knowing basic concepts of computer science, human-computer interaction, computer vision, signal processing.
Final exam:
TBD