Springer, 2010, -313 p.
With the development of silicon technologies, consumer electronics devices, such as personal computers, HDTV, mobile phones, digital cameras, and game consoles, have become ubiquitous for people’s daily life. These devices can provide multimedia sources for entertainment, communication, and so on. To interact with these equipments, consumers currently rely on devices such as remote controls, keyboards, or control panels, which are often inconvenient, ambiguous, and noninteractive. How to design user interfaces of CE products that enable natural, intuitive and fun interaction is one of the main challenges the CE industry is facing. Many companies and institutes are working on the advanced user interfaces.
User interface technologies have been studied in various disciplines for decades. Considering that modern CE products are usually supplied with both microphones and cameras, how to employ both audio and visual information for interactive multimedia has recently received much attention in both academia and industry. But interactive multimedia is still an under-explored field Many challenges exist when moving to multimodal interaction. For example, how to annotate and search huge data acquired by using multiple sensors, especially in the unconstrained end-user environments? How to effectively extract and select representative multimedia features for human behavior recognition? And how to select the fusion strategy of multimodal data for a given application? To address these challenges, we must adapt the existing approaches or fin new solutions suitable for multimedia interaction.
This book brings together high-quality and recent research advances on multimedia interaction, user interfaces, and particularly applications on consumer electronics. The targeted readers are researchers and practitioners working in the areas of multimedia analysis, human–computer interaction, and interactive user interfaces from both academia and industry. It can also be used as a reference book for graduate students studying computer vision, pattern recognition, or multimedia. In the following we summarize all the chapters.
Retrieving Human Actions Using Spatio-Temporal Features and Relevance Feedback
Computationally Efficient Clustering of Audio-Visual Meeting Data
Cognitive-Aware Modality Allocation in Intelligent Multimodal Information Presentation
Natural Human–Computer Interaction
Gesture Control for Consumer Electronics
Empirical Study of a Complete System for Real-Time Face Pose Estimation
Evolution-based Virtual Content Insertion with Visually Virtual Interactions in Videos
Physical Activity Recognition with Mobile Phones: Challenges, Methods, and Applications
Gestures in an Intelligent User Interface
Video Summary Quality Evaluation Based on 4C Assessment and User Interaction
Multimedia Experience on Web-Connected CE Devices