Augmented reality in the metaverse market: the role of multimodal sensory interaction

In the growing information systems (IS) literature on metaverse, augmented reality (AR) technology is regarded as a cornerstone of the metaverse which enables interaction services. Interaction has been identified as a core technology characteristic of metaverse shopping environments. Based on previous human–technology interaction research, the authors further explicate interaction to be multimodal sensory. The purpose of this study is thus to better understand the unique nature of interaction in AR technology and highlight the technology's benefits for shopping in metaverse spaces.

An experiment has been conducted to empirically examine the authors' research model. The authors use the structural equation modeling (SEM) approach to analyze the collected data.

This study conceptualizes image, motion and touchscreen interactions as the three dimensions of multimodal sensory interaction, which can reflect visual-, kinesthetic- and haptic-based sensation stimulation. The authors' findings show that multimodal sensory interaction of AR activates consumers' intention to purchase via a psychological process. To delineate this psychological process, the authors use feelings-as-information theory to posit that experiential factors can influence cognitive factors. More specifically, multimodal sensory interaction is shown to increase multisensory experience and spatial presence, which can effectively reduce product uncertainty and information overload. The two outcomes have been considered to be key issues in online shopping environments.

This study is one of the first ones that shed light on the multimodal sensory peculiarity of AR interactions in the extant IS literature. The authors further highlight the benefits of AR in addressing major online shopping concerns about product uncertainty and information overload, which are largely overlooked by prior research. This study uses feelings-as-information theory to explain the impacts of AR interactions, which reveal the essential role of the experiential process in sensory-enabling technologies. This study enriches the existing theoretical frameworks that mostly focus on the cognitive process. The authors' findings about AR interactions provide noteworthy guidelines for the design of metaverse environments and extend the authors' understanding of how the metaverse may bring benefits beyond traditional online shopping settings.