A multimodal smartwatch-based interaction concept for immersive
environments

J 2023

A multimodal smartwatch-based interaction concept for immersive environments

LANG, Matěj, Clemens STROBEL, Felix WECKESSER, Danielle Kathryn LANGLOIS, Enkelejda KASNECI et. al.

Basic information

Original name

A multimodal smartwatch-based interaction concept for immersive environments

Authors

LANG, Matěj (203 Czech Republic, guarantor, belonging to the institution), Clemens STROBEL, Felix WECKESSER, Danielle Kathryn LANGLOIS (840 United States of America, belonging to the institution), Enkelejda KASNECI, Barbora KOZLÍKOVÁ (203 Czech Republic, belonging to the institution) and Michael KRONE

Edition

Computers & Graphics, Oxford, Elsevier, 2023, 0097-8493

Other information

Language

English

Type of outcome

Článek v odborném periodiku

Field of Study

10200 1.2 Computer and information sciences

Country of publisher

United Kingdom of Great Britain and Northern Ireland

Confidentiality degree

není předmětem státního či obchodního tajemství

References:

URL

Impact factor

Impact factor: 2.500 in 2022

RIV identification code

RIV/00216224:14330/23:00132189

Organization unit

Faculty of Informatics

DOI

http://dx.doi.org/10.1016/j.cag.2023.10.010

UT WoS

001107076300001

Keywords in English

Smartwatch;AR user interaction;Gesture interface;Input device;User experience;Cross-device interaction

Abstract

V originále

Augmented and Virtual Reality (AR/VR) environments require user interaction concepts beyond the traditional mouse-and-keyboard setup for seated desktop computer usage. Although advanced input modalities such as hand or gaze tracking have been developed, they have yet to be widely adopted in available hardware. Modern smartwatches have been shown to provide a powerful and intuitive means of input, thereby overcoming the limitation of the current AR/VR headsets. They typically offer a set of interesting input modalities, such as a touchscreen, rotary buttons, and an Inertial Measurement Unit (IMU), which can be used for mid-air gesture recognition. Compared to other input devices, they have the benefit that they are hands-free as soon as the user stops interacting since they are attached to the wrist. As many concepts have been proposed, comparative evaluations of their effectiveness and user-friendliness are still rare. In this paper, we evaluate the usability of two commonly found approaches for using a smartwatch as an interaction device, specifically in immersive environments provided by AR/VR HMDs: using the physical inputs of the watch (touchscreen, rotary buttons) or mid-air gestures. We conducted a user study with 20 participants, where they tested both of the interaction methods, and we compared them in their usability and performance. Based on a prototypical AR application, we evaluated the performance and user experience of these two smartwatch-based interaction concepts. We have found that the input using a touchscreen and buttons was generally favored by the participants and led to shorter task completion times.

Links

MUNI/A/1339/2022, interní kód MU

Name: Rozvoj technik pro zpracování dat pro podporu vyhledávání, analýz a vizualizací rozsáhlých datových souborů s využitím umělé inteligence

Investor: Masaryk University, Development of data processing techniques to support search, analysis and visualization of large datasets using artificial intelligence

Citovat

LANG, Matěj, Clemens STROBEL, Felix WECKESSER, Danielle Kathryn LANGLOIS, Enkelejda KASNECI, Barbora KOZLÍKOVÁ and Michael KRONE. A multimodal smartwatch-based interaction concept for immersive environments. Computers & Graphics. Oxford: Elsevier, 2023, vol. 117, December, p. 85-95. ISSN 0097-8493. Available from: https://dx.doi.org/10.1016/j.cag.2023.10.010.

@article{2336598,
   author = {Lang, Matěj and Strobel, Clemens and Weckesser, Felix and Langlois, Danielle Kathryn and Kasneci, Enkelejda and Kozlíková, Barbora and Krone, Michael},
   article_location = {Oxford},
   article_number = {December},
   doi = {http://dx.doi.org/10.1016/j.cag.2023.10.010},
   keywords = {Smartwatch;AR user interaction;Gesture interface;Input device;User experience;Cross-device interaction},
   language = {eng},
   issn = {0097-8493},
   journal = {Computers & Graphics},
   title = {A multimodal smartwatch-based interaction concept for immersive environments},
   url = {https://www.sciencedirect.com/science/article/pii/S0097849323002479},
   volume = {117},
   year = {2023}
}

TY  - JOUR
ID  - 2336598
AU  - Lang, Matěj - Strobel, Clemens - Weckesser, Felix - Langlois, Danielle Kathryn - Kasneci, Enkelejda - Kozlíková, Barbora - Krone, Michael
PY  - 2023
TI  - A multimodal smartwatch-based interaction concept for immersive environments
JF  - Computers & Graphics
VL  - 117
IS  - December
SP  - 85-95
EP  - 85-95
PB  - Elsevier
SN  - 00978493
KW  - Smartwatch;AR user interaction;Gesture interface;Input device;User experience;Cross-device interaction
UR  - https://www.sciencedirect.com/science/article/pii/S0097849323002479
N2  - Augmented and Virtual Reality (AR/VR) environments require user interaction concepts beyond the traditional mouse-and-keyboard setup for seated desktop computer usage. Although advanced input modalities such as hand or gaze tracking have been developed, they have yet to be widely adopted in available hardware. Modern smartwatches have been shown to provide a powerful and intuitive means of input, thereby overcoming the limitation of the current AR/VR headsets. They typically offer a set of interesting input modalities, such as a touchscreen, rotary buttons, and an Inertial Measurement Unit (IMU), which can be used for mid-air gesture recognition. Compared to other input devices, they have the benefit that they are hands-free as soon as the user stops interacting since they are attached to the wrist. As many concepts have been proposed, comparative evaluations of their effectiveness and user-friendliness are still rare. In this paper, we evaluate the usability of two commonly found approaches for using a smartwatch as an interaction device, specifically in immersive environments provided by AR/VR HMDs: using the physical inputs of the watch (touchscreen, rotary buttons) or mid-air gestures. We conducted a user study with 20 participants, where they tested both of the interaction methods, and we compared them in their usability and performance. Based on a prototypical AR application, we evaluated the performance and user experience of these two smartwatch-based interaction concepts. We have found that the input using a touchscreen and buttons was generally favored by the participants and led to shorter task completion times.
ER  -

LANG, Matěj, Clemens STROBEL, Felix WECKESSER, Danielle Kathryn LANGLOIS, Enkelejda KASNECI, Barbora KOZLÍKOVÁ and Michael KRONE. A multimodal smartwatch-based interaction concept for immersive environments. \textit{Computers \&{} Graphics}. Oxford: Elsevier, 2023, vol.~117, December, p.~85-95. ISSN~0097-8493. Available from: https://dx.doi.org/10.1016/j.cag.2023.10.010.

Detailed Information on Publication Record