The SmARtphone Controller - Leveraging Smartphones as Input and Output Modality for Improved Interaction within Mobile Augmented Reality Environments
| dc.contributor.author | Knierim, Pascal | |
| dc.contributor.author | Hein, Dimitri | |
| dc.contributor.author | Schmidt, Albrecht | |
| dc.contributor.author | Kosch, Thomas | |
| dc.date.accessioned | 2021-05-13T16:40:40Z | |
| dc.date.available | 2021-05-13T16:40:40Z | |
| dc.date.issued | 2021 | |
| dc.description.abstract | Current interaction modalities for mobile Augmented Reality (AR) are tedious and lack expressiveness. To overcome these prevalent limitations, we developed and evaluated a multimodal interaction concept by pairing a smartphone as an input and output modality for mobile AR. In a user study (n = 24), we investigated the effects on interaction speed, accuracy, and task load for (1) virtual object manipulation as well as (2) interaction with established graphical user interfaces (GUIs). Our findings show that a smartphone-based AR controller results in significantly faster and more accurate object manipulation with reduced task load than state-of-art mid-air gestures. Our results also indicate a significant enhancement for using the physical touchscreen as a modality compared to mid-air gestures for GUI interaction. We conclude that interaction in mobile AR environments can be improved by utilizing a smartphone as an omnipresent controller. Additionally, we discuss how future AR systems can benefit from tangible touchscreens as an additional and complementary interaction modality. | en |
| dc.identifier.doi | 10.1515/icom-2021-0003 | |
| dc.identifier.pissn | 2196-6826 | |
| dc.identifier.uri | https://dl.gi.de/handle/20.500.12116/36431 | |
| dc.language.iso | en | |
| dc.publisher | De Gruyter | |
| dc.relation.ispartof | i-com: Vol. 20, No. 1 | |
| dc.subject | Augmented Reality | |
| dc.subject | Head-Mounted Display | |
| dc.subject | Smartphone | |
| dc.subject | Object Manipulation | |
| dc.subject | Multi-Display Interaction | |
| dc.title | The SmARtphone Controller - Leveraging Smartphones as Input and Output Modality for Improved Interaction within Mobile Augmented Reality Environments | en |
| dc.type | Text/Journal Article | |
| gi.citation.endPage | 61 | |
| gi.citation.publisherPlace | Berlin | |
| gi.citation.startPage | 49 |