With the increasing prevalence of smartphones, gesture-based interaction has arrived in our everyday life, but we still do not exploit its full potential. This paper describes the benefits and drawbacks of gestural input and presents interaction techniques that address these drawbacks.
Gestures provide the user with a new form of interaction that mirrors their experience in the real world. They feel natural and require neither interruption nor an additional device. Furthermore, they do not limit the user to a single point of input, but instead offer various forms of interaction.
However, gestures also raise issues that are not relevant with traditional methods of input. The need to be learned and remembered, which requires the development of guides that promote the discoverability and memorability of these gestures and deal with input and recognition errors. Another aspect is the design of the gestures itself, which should make them memorable and easy and comfortable to execute.
Table of Contents
1. Introduction
2. Advantages
2.1 Immediate and powerful interaction
2.2 Intuitiveness and enjoyability
3. Drawbacks and possible solutions
3.1 Discoverability
3.2 Memorability
3.3 Fatigue
3.4 Recognition Errors
3.4.1 Immersion
3.4.2 Exit errors
4. Conclusion
Research Objectives and Themes
This paper examines the integration of gesture-based interaction in modern computing, focusing on the trade-offs between natural user experience and technical implementation challenges. The primary research objective is to identify the core benefits of gestural input and propose solutions for the inherent limitations regarding learnability, recognition, and physical strain.
- Benefits of natural gestural input vs. traditional devices
- Methods for improving gesture discoverability and user learning
- Design considerations for memorability and intuitiveness
- Strategies to mitigate fatigue and recognition errors in gesture interfaces
Excerpt from the Book
3.1 Discoverability
A disadvantage with gestures, as already identified by Baudel and Beaudouin-Lafon in 1993, is the fact that they are neither self-revealing nor self-explanatory. A named button on a toolbar has an explicit purpose and is also easy to find, gestures, however, may be arbitrary and are usually more difficult to discover.
In order to solve this problem, Bau and Mackay (2008) proposed OctoPocus, a dynamic guide that combines feedforward and feedback mechanisms. After a press-and-wait gesture, a map of all possible gestures, visualized through coloured templates, is displayed around the current cursor position. As the user begins to follow a path, the other paths become progressively thinner, indicating that they're less likely to be recognized, until they disappear (see Figure 1).
A solution that is also suitable for multi-touch input is the ShadowGuides system by Freeman et al. A so-called user-shadow visualizes the user's input, giving feedback on what parts of the hand are in contact with the surface. The user shadow annotations demonstrate possible gestures available from the current hand pose, the registration pose guide informs the user about alternative registration poses. (2009)
Another, a little different approach is GestureBar by Bragdon et al. While the aforementioned learning guides employ the "learning-by-doing" technique, GestureBar separates the learning area from the user's document and discloses information about a gesture only if needed. The system works like a traditional toolbar - the user can click an item to find details about the execution of the command and to test it in an experimental area. (Bragdon, Zeleznik, Williamson, Miller & LaViola, 2009)
Summary of Chapters
1. Introduction: Outlines the growing prevalence of gesture-controlled surfaces and the move toward imitating natural human communication in software interfaces.
2. Advantages: Discusses how gestures provide more flexible, immediate, and intuitive input compared to traditional hardware like the mouse.
3. Drawbacks and possible solutions: Analyzes the hurdles of learnability, fatigue, and recognition errors, while presenting technical aids like guides and feedback systems to address them.
4. Conclusion: Summarizes that while gestures are a promising and efficient interaction form, they require better support for novice users and further development to reach their full potential.
Keywords
gesture, guide, learnability, gesture design, memorability, gesture recognition, multi-touch, mid-air interaction, user-shadow, OctoPocus, ShadowGuides, GestureBar, input devices, human-computer interaction
Frequently Asked Questions
What is the primary focus of this paper?
The paper explores the current state of gesture-based interaction, balancing the benefits of a more natural user experience against the practical challenges of implementation and usability.
What are the central thematic areas discussed?
The core themes include user interface design, the learnability of non-explicit gestures, the mitigation of physical fatigue, and the technical challenge of accurate gesture recognition.
What is the primary research goal?
The goal is to describe both the advantages and the significant drawbacks of gestural input and to present effective interaction techniques that help users overcome these barriers.
Which scientific methods are primarily used?
This is a review and synthesis paper that evaluates existing studies and interaction systems (such as OctoPocus or ShadowGuides) to draw conclusions about best practices in gesture design.
What is covered in the main section of the paper?
The main section details the specific problems of discoverability, memorability, fatigue, and recognition errors, offering technical solutions for each issue to improve the user experience.
Which keywords best characterize the work?
Key terms include gesture, learnability, gesture design, memorability, gesture recognition, and various interaction systems like ShadowGuides and GestureBar.
What is the "Midas Touch" problem?
It is a specific recognition error where the system interprets unintended hand movements as intentional gestures, a problem that necessitates the definition of specific interaction zones.
How do Augmented Letters function as a solution?
Augmented Letters allow users to initiate a command by drawing the first letter of the function, which then invokes a menu, bridging the gap between novice exploration and expert-level gesture execution.
Why is fatigue a major concern for gesture-based interfaces?
Gestures, especially mid-air interactions, often require sustained muscle tension and complex movements, which can be significantly more exhausting for the user than traditional mouse or keyboard input.
- Quote paper
- Andrea Attwenger (Author), 2014, Advantages and Drawbacks of Gesture-based Interaction, Munich, GRIN Verlag, https://www.grin.com/document/369514
