A multimodal smartwatch-based interaction concept for immersive
environments

J 2023

A multimodal smartwatch-based interaction concept for immersive environments

LANG, Matěj, Clemens STROBEL, Felix WECKESSER, Danielle Kathryn LANGLOIS, Enkelejda KASNECI et. al.

Základní údaje

Originální název

A multimodal smartwatch-based interaction concept for immersive environments

Autoři

LANG, Matěj (203 Česká republika, garant, domácí), Clemens STROBEL, Felix WECKESSER, Danielle Kathryn LANGLOIS (840 Spojené státy, domácí), Enkelejda KASNECI, Barbora KOZLÍKOVÁ (203 Česká republika, domácí) a Michael KRONE

Vydání

Computers & Graphics, Oxford, Elsevier, 2023, 0097-8493

Další údaje

Jazyk

angličtina

Typ výsledku

Článek v odborném periodiku

Obor

10200 1.2 Computer and information sciences

Stát vydavatele

Velká Británie a Severní Irsko

Utajení

není předmětem státního či obchodního tajemství

Odkazy

URL

Impakt faktor

Impact factor: 2.500 v roce 2022

Kód RIV

RIV/00216224:14330/23:00132189

Organizační jednotka

Fakulta informatiky

DOI

http://dx.doi.org/10.1016/j.cag.2023.10.010

UT WoS

001107076300001

Klíčová slova anglicky

Smartwatch;AR user interaction;Gesture interface;Input device;User experience;Cross-device interaction

Příznaky

Mezinárodní význam, Recenzováno

Změněno: 7. 4. 2024 23:35, RNDr. Pavel Šmerk, Ph.D.

Anotace

V originále

Augmented and Virtual Reality (AR/VR) environments require user interaction concepts beyond the traditional mouse-and-keyboard setup for seated desktop computer usage. Although advanced input modalities such as hand or gaze tracking have been developed, they have yet to be widely adopted in available hardware. Modern smartwatches have been shown to provide a powerful and intuitive means of input, thereby overcoming the limitation of the current AR/VR headsets. They typically offer a set of interesting input modalities, such as a touchscreen, rotary buttons, and an Inertial Measurement Unit (IMU), which can be used for mid-air gesture recognition. Compared to other input devices, they have the benefit that they are hands-free as soon as the user stops interacting since they are attached to the wrist. As many concepts have been proposed, comparative evaluations of their effectiveness and user-friendliness are still rare. In this paper, we evaluate the usability of two commonly found approaches for using a smartwatch as an interaction device, specifically in immersive environments provided by AR/VR HMDs: using the physical inputs of the watch (touchscreen, rotary buttons) or mid-air gestures. We conducted a user study with 20 participants, where they tested both of the interaction methods, and we compared them in their usability and performance. Based on a prototypical AR application, we evaluated the performance and user experience of these two smartwatch-based interaction concepts. We have found that the input using a touchscreen and buttons was generally favored by the participants and led to shorter task completion times.

Návaznosti

MUNI/A/1339/2022, interní kód MU

Název: Rozvoj technik pro zpracování dat pro podporu vyhledávání, analýz a vizualizací rozsáhlých datových souborů s využitím umělé inteligence

Investor: Masarykova univerzita, Rozvoj technik pro zpracování dat pro podporu vyhledávání, analýz a vizualizací rozsáhlých datových souborů s využitím umělé inteligence

Citovat

LANG, Matěj, Clemens STROBEL, Felix WECKESSER, Danielle Kathryn LANGLOIS, Enkelejda KASNECI, Barbora KOZLÍKOVÁ a Michael KRONE. A multimodal smartwatch-based interaction concept for immersive environments. Computers & Graphics. Oxford: Elsevier, 2023, roč. 117, December, s. 85-95. ISSN 0097-8493. Dostupné z: https://dx.doi.org/10.1016/j.cag.2023.10.010.

@article{2336598,
   author = {Lang, Matěj and Strobel, Clemens and Weckesser, Felix and Langlois, Danielle Kathryn and Kasneci, Enkelejda and Kozlíková, Barbora and Krone, Michael},
   article_location = {Oxford},
   article_number = {December},
   doi = {http://dx.doi.org/10.1016/j.cag.2023.10.010},
   keywords = {Smartwatch;AR user interaction;Gesture interface;Input device;User experience;Cross-device interaction},
   language = {eng},
   issn = {0097-8493},
   journal = {Computers & Graphics},
   title = {A multimodal smartwatch-based interaction concept for immersive environments},
   url = {https://www.sciencedirect.com/science/article/pii/S0097849323002479},
   volume = {117},
   year = {2023}
}

TY  - JOUR
ID  - 2336598
AU  - Lang, Matěj - Strobel, Clemens - Weckesser, Felix - Langlois, Danielle Kathryn - Kasneci, Enkelejda - Kozlíková, Barbora - Krone, Michael
PY  - 2023
TI  - A multimodal smartwatch-based interaction concept for immersive environments
JF  - Computers & Graphics
VL  - 117
IS  - December
SP  - 85-95
EP  - 85-95
PB  - Elsevier
SN  - 00978493
KW  - Smartwatch;AR user interaction;Gesture interface;Input device;User experience;Cross-device interaction
UR  - https://www.sciencedirect.com/science/article/pii/S0097849323002479
N2  - Augmented and Virtual Reality (AR/VR) environments require user interaction concepts beyond the traditional mouse-and-keyboard setup for seated desktop computer usage. Although advanced input modalities such as hand or gaze tracking have been developed, they have yet to be widely adopted in available hardware. Modern smartwatches have been shown to provide a powerful and intuitive means of input, thereby overcoming the limitation of the current AR/VR headsets. They typically offer a set of interesting input modalities, such as a touchscreen, rotary buttons, and an Inertial Measurement Unit (IMU), which can be used for mid-air gesture recognition. Compared to other input devices, they have the benefit that they are hands-free as soon as the user stops interacting since they are attached to the wrist. As many concepts have been proposed, comparative evaluations of their effectiveness and user-friendliness are still rare. In this paper, we evaluate the usability of two commonly found approaches for using a smartwatch as an interaction device, specifically in immersive environments provided by AR/VR HMDs: using the physical inputs of the watch (touchscreen, rotary buttons) or mid-air gestures. We conducted a user study with 20 participants, where they tested both of the interaction methods, and we compared them in their usability and performance. Based on a prototypical AR application, we evaluated the performance and user experience of these two smartwatch-based interaction concepts. We have found that the input using a touchscreen and buttons was generally favored by the participants and led to shorter task completion times.
ER  -

LANG, Matěj, Clemens STROBEL, Felix WECKESSER, Danielle Kathryn LANGLOIS, Enkelejda KASNECI, Barbora KOZLÍKOVÁ a Michael KRONE. A multimodal smartwatch-based interaction concept for immersive environments. \textit{Computers \&{} Graphics}. Oxford: Elsevier, 2023, roč.~117, December, s.~85-95. ISSN~0097-8493. Dostupné z: https://dx.doi.org/10.1016/j.cag.2023.10.010.

Podrobný výpis o publikaci