Startseite
/
Issues
/
16.2019
/
Designing Mobile Multimodal Interaction for Visually Impaired and Older Adults: Challenges and Possible Solutions
No section
Designing Mobile Multimodal Interaction for Visually Impaired and Older Adults: Challenges and Possible Solutions
-
Michela Ferron
Fondazione Bruno Kessler, now at Dedagroup Public Services
-
Nadia Mana
Fondazione Bruno Kessler
-
Ornella Mich
Fondazione Bruno Kessler
-
Christopher Reeves
Streetlab
-
Gianluca Schiavo
Fondazione Bruno Kessler
Zusammenfassung
This paper presents two early studies aimed at investigating issues concerning the design of multimodal interaction based on voice commands and one-hand mid-air gestures - with mobile technology specifically designed for visually impaired and elderly users. These studies were carried out on a new device allowing enhanced speech recognition (including lip movement analysis) and mid-air gesture interaction on Android operating system (smartphone and tablet PC). We discuss the initial findings and challenges raised by these novel interaction modalities, and in particular the issues regarding the design of feedback and feedforward, the problem of false positives, and the correct orientation and distance of the hand and the device during the interaction. Finally, we present a set of feedback and feedforward solutions designed to overcome the main issues highlighted.
-
eingereicht:
25.05.2018,
-
akzeptiert:
29.07.2018,
-
veröffentlicht:
06.10.2020
Keywords
Empfohlene Zitierweise
¶
Michela Ferron, Nadia Mana, Ornella Mich, Christopher Reeves, and Gianluca Schiavo, Designing Mobile Multimodal Interaction for Visually Impaired and Older Adults: Challenges and Possible Solutions. Journal of Virtual Reality and Broadcasting, 16(2019), no. 2. (urn:nbn:de:0009-6-49583)
Bitte geben Sie beim Zitieren dieses Artikels die exakte URL und das Datum Ihres letzten Besuchs bei dieser Online-Adresse an.
Anzahl der Zitationen
Besuchen Sie Google Scholar um herauszufinden, wie oft dieser Artikel zitiert wurde.