Perception enhancement of human multi robot team human member based on multimodal haptic feedback

DOI:	10.11809/bqzbgcxb2025.01.034
Keywords:	multimodal haptic feedback; sensory enhancement; human multi robot team; human machine collaboration; wearable devices
Abstract:	To address the problem of decreased situational awareness of team status and the location of task objectives due to excessive visual channel load and limited auditory channel in silent combat in non open environments, a wearable multimodal haptic feedback device for the forearm was developed. A method has been proposed to enhance the situational awareness of team human member using multi modal haptic feedback technology, and a human multi robot team collaborative motion system based on multi modal haptic feedback has been designed. During human robot team collaborative motion, the system uses the device’s squeeze and vibration haptic modalities to provide feedback to team human member about the consistency of team speed and navigation information to the task target. In a long distance navigation experiment conducted in a virtual urban environment, various indicators were compared under two experimental conditions: visual and tactile feedback combined and visual feedback only. The results showed that compared to the visual feedback only condition, the total task completion time under the visual and tactile feedback combined condition decreased by 7.93%, the response time of team speed inconsistency decreased by 61.89%, and the subjective perception effectiveness of the subjects increased by 35.59%. During human multi robot team collaborative motion, utilizing multimodal tactile feedback technology can effectively enhance the team human member’s situational awareness of the team’s status and the location of task objectives.
Issue:	Vol. 46 No. 1 (2025)
Published:	2025-01-31
PDF