多通道人机交互中感觉刺激的模拟方法研究综述

目的 对多通道人机交互中感觉刺激模拟方法的研究现状进行梳理,总结现有研究中的相关技术原理与方法,为后续的相关研究和实践提供参考。方法 利用文献调研和典型案例分析方法,梳理了触觉、嗅觉及味觉三种单通道感觉刺激模拟的相关技术;概述了多通道感觉刺激融合的认知学理论,并以视听触融合、视听嗅融合为例,总结了多通道感觉刺激融合的具体实现方法;介绍了多通道感觉刺激融合在医疗康复、虚拟购物、智能教育等典型场景中的应用。结论 多通道人机交互中感觉刺激的模拟方法研究有望支持低负荷、高效率的新型人机交互方式,甚至带来超越真实的交互体验,具备广泛的应用潜力。

Review of Sensory Feedback Simulation Methods in Multi-modal Human-computer Interaction

The work aims to sort out the research status of sensory feedback simulation methods in multi-modal human-computer interaction and summarize the principles and implementation methods of related techniques in existing research, so as to provide references for the subsequent research and practice. Firstly, the techniques used to simulate haptic, olfactory, and gustatory feedback were summarized respectively by reviewing literature and studying typical cases. Then, the cognitive theories about multi-modal sensory integration were outlined and the specific implementation methods were introduced by taking visual-aural-haptic and visual-aural-olfactory feedback integration as examples. Finally, the application of multi-modal sensory feedback in typical scenarios such as medical rehabilitation, virtual shopping, and intelligent education was expounded. The research of sensory feedback simulation methods in multi-modal human-computer interaction is expected to support a new type of human-computer interaction with low load and high efficiency. It can even deliver an interactive experience that goes beyond reality, representing a wide range of application potential.