The Handbook of Multimodal-Multisensor Interfaces provides the first authoritative resource on what has become the dominant paradigm for new computer interfaces: user input involving new media (speech, multi-touch, hand and body gestures, facial expressions, writing) embedded in multimodal-multisensor interfaces that often include biosignals. This edited collection is written by international experts and pioneers in the field. It provides a textbook, reference, and technology roadmap for professionals working in this and related areas. This second volume of the handbook begins with multimodal signal processing, architectures, and machine learning. It includes recent deep learning approaches for processing multisensorial and multimodal user data and interaction, as well as context-sensitivity. A further highlight is processing of information about users' states and traits, an exciting emerging capability in next-generation user interfaces. These chapters discuss real-time multimodal analysis of emotion and social signals from various modalities, and perception of affective expression by users. Further chapters discuss multimodal processing of cognitive state using behavioral and physiological signals to detect cognitive load, domain expertise, deception, and depression. This collection of chapters provides walk-through examples of system design and processing, information on tools and practical resources for developing and evaluating new systems, and terminology and tutorial support for mastering this rapidly expanding field. In the final section of this volume, experts exchange views on the timely and controversial challenge topic of multimodal deep learning. The discussion focuses on how multimodal-multisensor interfaces are most likely to advance human performance during the next decade.

The Handbook of Multimodal-Multisensor Interfaces provides the first authoritative resource on what has become the dominant paradigm for new computer interfaces- user input involving new media (speech, multi-touch, gestures, writing) embedded in multimodal-multisensor interfaces. These interfaces support smart phones, wearables, in-vehicle and robotic applications, and many other areas that are now highly competitive commercially. This edited collection is written by international experts and pioneers in the field. It provides a textbook, reference, and technology roadmap for professionals working in this and related areas. This first volume of the handbook presents relevant theory and neuroscience foundations for guiding the development of high-performance systems. Additional chapters discuss approaches to user modeling and interface designs that support user choice, that synergistically combine modalities with sensors, and that blend multimodal input and output. This volume also highlights an in-depth look at the most common multimodal-multisensor combinations-for example, touch and pen input, haptic and non-speech audio output, and speech-centric systems that co-process either gestures, pen input, gaze, or visible lip movements. A common theme throughout these chapters is supporting mobility and individual differences among users. These handbook chapters provide walk-through examples of system design and processing, information on tools and practical resources for developing and evaluating new systems, and terminology and tutorial support for mastering this emerging field. In the final section of this volume, experts exchange views on a timely and controversial challenge topic, and how they believe multimodal-multisensor interfaces should be designed in the future to most effectively advance human performance.

Our increasingly smart environments will sense, track and model users and provide them with personalized services. We can already embed computers in everyday objects such as shirt buttons and pencils; objects of all sizes, from wristwatches to billboards, will soon incorporate high-quality flexible displays; we have improved access to wireless Internet communication; and we are now transitioning from traditional linear to targeted interactive media. The convergence of these factors -- miniaturization, display technologies, wireless communication, and interactive media -- will allow us to leave our desktop computers and move to a radical computing paradigm, the ubiquitous display environment, where media and visual content will support a rich variety of display devices that enable users to interact with information artifacts in a seamless manner. This is one of the most exciting and important areas of technology development and this book addresses the challenge within the context of an educational and cultural experience. This is inherently a multidisciplinary field and the contributions span the related research aspects, including system architecture and communications issues, and intelligent user interface aspects such as aesthetics and privacy. On the scientific side, the authors integrate artificial intelligence, user modeling, temporal and spatial reasoning, intelligent user interfaces, and user-centric design methodologies in their work, while on the technological side they integrate mobile and wireless networking infrastructures, interfaces, group displays, and context-driven adaptive presentations. This book is of value to researchers and practitioners working on all aspects of ubiquitous display environments, and we hope it leads to innovations in human education, cultural heritage appreciation, and scientific development.

This book constitutes the refereed proceedings of the 35th Annual German Conference on Artificial Intelligence, KI 2012, held in Saarbrucken, Germany, in September 2012. The 19 revised full papers presented together with 9 short papers were carefully reviewed and selected from 57 submissions. The papers contain research results on theory and applicaiton of all aspects of AI.

This book constitutes the refereed proceedings of the 10th International Conference on Pervasive Computing, Pervasive 2012, held in Newcastle, UK, in June 2012. The 28 revised papers presented were carefully reviewed and selected from 138 submissions. The contributions are grouped into the following topical sections: activity capturing; urban mobility and computing; home and energy; HCI; development tools and devices; indoor location and positioning; social computing and games; privacy; public displays and services.

This book constitutes the refereed proceedings of the 11th International Symposium on Smart Graphics, SG 2011, held in Bremen, Germany, in July 2011. The 10 revised full papers presented together with 12 short papers and 4 systems demonstrations were carefully reviewed and selected from numerous submissions covering a wide range of topics including view and camera control; three-dimensional modeling; visual information encoding; video projection; information visualization; interaction techniques; visual communication; and graphics and audio.

th Welcome to the proceedings of the 8 International Conference on Pervasive Computing (Pervasive 2010). After Toronto, Sydney and Nara, the conference has now returned to Europe. Pervasiveis one of the most important conferences in the area of pervasive and ubiquitous computing. Asinthepreviousyear,wehadtwocategoriesoftechnicalpapers:FullPapers and Notes. Pervasive attracted 157 valid submissions, from which the Technical Program Committee (TPC) accepted 24 full papers and one note, resulting in an overall acceptance rate of 16%. The submissions included 628 authors from 27 countries representing all the continents (except Antarctica). As we can see from these ?gures, Pervasive is a truly global highly competitive conference. A major conference such as Pervasive requires a rigorous and objective p- cess for selecting papers. This starts with the selection of a high-quality TPC. We were fortunate to be able to draw on the wisdom and experience of our 28 TPC members, from the most prestigious universities and research labs in - rope, North America, and Asia. This committee was aided by the input of no less than 238 external reviewers chosen on the basis of their domain knowledge and relevance to pervasive computing. The papers were selected using a double-blind review, with four peer reviews perpaper,adiscussionphaseamongthereviewers,andadiscussionofthepapers in the TPC meeting, which was held in Palo Alto during December 12-13, 2009. We thank Nokia Research Center for hosting the meeting.

Ubiquitous user modeling differs from generic user modeling by three additional concepts: ongoing modeling, ongoing sharing, and ongoing exploitation. Systems that share their user models will improve the coverage, the level of detail, and the reliability of the integrated user models and thus allow better functions of adaptation. Ubiquitous user modeling implies new challenges of interchangeability, scalability, scrutability, and privacy.

This volume presents results of a series of workshops on the topic of Ubiquitous User Modeling since 2003 and additional workshops at various other conferences e.g. on User Modeling and Adaptive Hypermedia in the last four years.

The 8 revised full papers presented were carefully reviewed and selected from the best lectures given at the workshops and were significantly extended to be included in the book.

Smartgraphicsarepervasivein ourlives nowadays.Thewaysartistsand desi- ersproduceimagesthate?ectivelysupporthumancognitionandcommunication are continuously changing and evolving as they incorporate novel methods p- vided by the advances in science and technology. As a counterpart, the radically new visions in most art forms have stimulated scientists to breath-taking levels of achievement. This symbiotic relationship between art and science (and technology) is one of the foundations of the technological culture of contemporary society and is especiallyevidentinthecreationofsmartgraphics.Suchaprocessrestsonadeep understanding of the fundamentals of perception and cognition as they relate to interaction and communication technologies, together with arti?cial intelligence andcomputergraphicstechniques, toautomatereasoningandenhancecognition. The International Symposium on Smart Graphics 2009 was held from May 28-30 in Salamanca, Spain. With this edition we celebrated our tenth anniv- sary: a successful series of inspiring and exciting meetings originating in 2000 as an American Association for Arti?cial Intelligence Spring Symposium. This year we proposed a speci?c emphasis on visual analytics as well as all kinds of transversalresearchthat harnesses the power of humans and technol- icalartifacts in order to convey, understandanddeal with complex scienti?c and socialprocesses.Wewereluckyto haveDanielKeim andJ] ornKohlhammer, two internationally renowned experts on this area of research, as invited speakers

This book constitutes the refereed proceedings of the 8th International Symposium on Smart Graphics, SG 2007, held in Kyoto, Japan in June 2007 jointly with the Visual Computing / Graphics and CAD symposium, which takes place in Osaka, Japan. It covers interaction, lifelike characters and affective computing, knowledge-based graphics generation and interaction, and visualization and graphics algorithms.

This book constitutes the refereed proceedings of the 6th International Symposium on Smart Graphics, SG 2006, held in Vancouver, Canada, July 2006. The book presents 19 revised full papers and 8 revised short papers. The papers are organized in topical sections on intelligent text processing, perceptive systems, smart visualization, visual features, sketching and graphical abstraction, intelligent image and film composing, as well as smart interaction.

TheInternationalSymposiumonSmartGraphics2005washeldfromAugust22- 24, 2005 in the cloister Frauenwort ] h on the island of Frauenchiemsee, Germany. It was the sixth event in a series which originally started in 2000 as a AAAI Spring Symposium. Inresponsetotheoverwhelmingsuccessofthe2000symposium, itsorganizers decided to turn it into a self-contained event. With the support of IBM, the ?rst two International Symposia on Smart Graphics were held at the T.J. Watson Research Center in Hawthorne, NY in 2001 and 2002. The 2003 symposium moved to the European Media Lab in Heidelberg to underline the international character of the Smart Graphics enterprise and its community. The core idea behind these symposia is to bring together researchers and practitioners fromthe ?eld ofcomputer graphics, arti?cialintelligence, cognitive science, graphic design and the ?ne arts. Each of these disciplines contributes to what we mean by the term "Smart Graphics" the intelligent process of creating e?ective, expressive and esthetic graphical presentation. Many Smart Graphics symposiaemphasizea particularaspectofthe?eldin thecallfor papers.In2005 our focus was on "Visual Analytics"- the art and science of analytical reasoning facilitated by interactive visual interfaces."

The International Symposium on Smart Graphics 2004 was held on May 23-25, 2004 in Ban?, Canada. It was the ?fth event in a series which originally started in 2000 as a AAAI Spring Symposium. In response to the overwhelming success of the 2000 symposium, its organizers decided to turn it into a self-contained event in 2001. With the support of IBM, the ?rst two InternationalSymposia on Smart Graphics were held at the T. J. Watson Research Center in Hawthorne, NY in 2001 and 2002. The 2003 symposium moved to the European Media Lab in Heidelberg to underline the international character of the Smart Graphics enterprise and its community. The 2004 symposium particularly emphasized the contribution of arts and design to the interdisciplinary ?eld of Smart Graphics andwasthereforeheldattheBan?CentreinAlberta, Canada, aninternationally recognized center of creative excellence. The core idea behind these symposia is to bring together researchers and practitioners from the ?eld of computer graphics, arti?cial intelligence, cog- tive psychology and the ?ne arts. Each of these disciplines contributes to what we mean by the term "Smart Graphics" the intelligent process of creating - pressive and esthetic graphical presentations. While artists and designers have been creatingcommunicativegraphicsfor centuries, arti?cialintelligencefocuses on automating this process by means of the computer. While computer graphics providesthetoolsforcreatinggraphicalpresentationsinthe?rstplace, cognitive sciences contribute the rules and models of perception necessary for the design of e?ective graphics.

This book constitutes the refereed proceedings of the Third International Symposium on Smart Graphics, SG 2003, held in Heidelberg, Germany in July 2003. The 19 revised full papers and 7 poster papers presented were carefully reviewed and selected for presentation. The papers address smart graphics issues from the points of view of computer science, artificial intelligence, cognitive psychology, and fine art. The papers are organized in topical sections on graphical interaction, visualization techniques, virtual characters, and camera planning.

The Handbook of Multimodal-Multisensor Interfaces provides the first authoritative resource on what has become the dominant paradigm for new computer interfaces-user input involving new media (speech, multi-touch, hand and body gestures, facial expressions, writing) embedded in multimodal-multisensor interfaces.This three-volume handbook is written by international experts and pioneers in the field. It provides a textbook, reference, and technology roadmap for professionals working in this and related areas. This third volume focuses on state-of-the-art multimodal language and dialogue processing, including semantic integration of modalities. The development of increasingly expressive embodied agents and robots has become an active test bed for coordinating multimodal dialogue input and output, including processing of language and nonverbal communication. In addition, major application areas are featured for commercializing multimodal-multisensor systems, including automotive, robotic, manufacturing, machine translation, banking, communications, and others. These systems rely heavily on software tools, data resources, and international standards to facilitate their development. For insights into the future, emerging multimodal-multisensor technology trends are highlighted in medicine, robotics, interaction with smart spaces, and similar areas. Finally, this volume discusses the societal impact of more widespread adoption of these systems, such as privacy risks and how to mitigate them. The handbook chapters provide a number of walk-through examples of system design and processing, information on practical resources for developing and evaluating new systems, and terminology and tutorial support for mastering this emerging field. In the final section of this volume, experts exchange views on a timely and controversial challenge topic, and how they believe multimodal-multisensor interfaces need to be equipped to most effectively advance human performance during the next decade.

The Handbook of Multimodal-Multisensor Interfaces provides the first authoritative resource on what has become the dominant paradigm for new computer interfaces: user input involving new media (speech, multi-touch, hand and body gestures, facial expressions, writing) embedded in multimodal-multisensor interfaces that often include biosignals. This edited collection is written by international experts and pioneers in the field. It provides a textbook, reference, and technology roadmap for professionals working in this and related areas. This second volume of the handbook begins with multimodal signal processing, architectures, and machine learning. It includes recent deep learning approaches for processing multisensorial and multimodal user data and interaction, as well as context-sensitivity. A further highlight is processing of information about users' states and traits, an exciting emerging capability in next-generation user interfaces. These chapters discuss real-time multimodal analysis of emotion and social signals from various modalities, and perception of affective expression by users. Further chapters discuss multimodal processing of cognitive state using behavioral and physiological signals to detect cognitive load, domain expertise, deception, and depression. This collection of chapters provides walk-through examples of system design and processing, information on tools and practical resources for developing and evaluating new systems, and terminology and tutorial support for mastering this rapidly expanding field. In the final section of this volume, experts exchange views on the timely and controversial challenge topic of multimodal deep learning. The discussion focuses on how multimodal-multisensor interfaces are most likely to advance human performance during the next decade.

The Handbook of Multimodal-Multisensor Interfaces provides the first authoritative resource on what has become the dominant paradigm for new computer interfaces- user input involving new media (speech, multi-touch, gestures, writing) embedded in multimodal-multisensor interfaces. These interfaces support smart phones, wearables, in-vehicle and robotic applications, and many other areas that are now highly competitive commercially. This edited collection is written by international experts and pioneers in the field. It provides a textbook, reference, and technology roadmap for professionals working in this and related areas. This first volume of the handbook presents relevant theory and neuroscience foundations for guiding the development of high-performance systems. Additional chapters discuss approaches to user modeling and interface designs that support user choice, that synergistically combine modalities with sensors, and that blend multimodal input and output. This volume also highlights an in-depth look at the most common multimodal-multisensor combinations-for example, touch and pen input, haptic and non-speech audio output, and speech-centric systems that co-process either gestures, pen input, gaze, or visible lip movements. A common theme throughout these chapters is supporting mobility and individual differences among users. These handbook chapters provide walk-through examples of system design and processing, information on tools and practical resources for developing and evaluating new systems, and terminology and tutorial support for mastering this emerging field. In the final section of this volume, experts exchange views on a timely and controversial challenge topic, and how they believe multimodal-multisensor interfaces should be designed in the future to most effectively advance human performance.

Dieses kompakte Grundlagen-Lehrbuch orientiert sich in Inhalt und Aufbau an einer einfuhrenden Vorlesung zum Thema Mensch-Maschine-Interaktion und lehnt sich an das von der Association for Computing Machinery (ACM) vorgeschlagene Curriculum des Gebiets an. Es besteht aus vier grossen Teilen. Davon umfassen die ersten drei den Stoff der Grundvorlesung und behandeln nacheinander die menschliche Seite (u.a.Wahrnehmung, Informationsverarbeitung, Motorik), die Seite der Maschine (u.a. technische Grundlagen, etablierte Interaktionsformen) und den Entwicklungsprozess (User Centered Design, Prototypen, Evaluation). Der vierte Teil gibt einen Ausblick auf spezielle Anwendungsgebiete (Desktop und Web, Touch, mobile Interaktion) und bildet damit den Leitfaden fur eine aufbauende Vorlesung. Begleitet wird das Buch durch eine Webseite (mmibuch.de) mit Material fur Studierende (UEbungsaufgaben, Musterloesungen, multimediale Inhalte) und Dozenten (Bildmaterial, Vorlesungsfolien, weiterfuhrende Literatur). Prof. Dr. Andreas Butz, LMU Munchen Prof. Dr. Antonio Kruger, Deutschen Forschungszentrum fur Kunstliche Intelligenz (DFKI)