Proxemic Aware Augmented Reality For Human Robot Interaction
Publication Conference Paper2023

Proxemic-aware Augmented Reality For Human-Robot Interaction

Abstract

This study introduces a novel proxemic-aware augmented reality (AR) system to mitigate information overload in AR-enabled human-robot interaction (HRI). The system leverages human-robot proxemics to automatically adjust what and how much visual content needs to be presented. Therefore, the operator can perceive the relevant data through AR interfaces without being overwhelmed by excessive information exposure. We propose a task-specific model for evaluating human-robot proxemic (HRP), where the system can identify HRP levels based on raw features, such as distance and orientation. Based on HRP levels, we design a set of visual elements for presenting robots’ information at various levels of detail. To demonstrate the functionality of the system, we present a series of proof-of-concept applications showing that our system can assist the operator in a wide range of HRI tasks. The user study proves that the proxemic-aware AR system can reduce mental loading, increase visual clarity, and improve interaction efficiency in HRI.

Fig. 1. Proxemic-aware augmented reality (AR) may mitigate information overloading in AR-based human-robot interaction (HRI) (a) an AR interface displays all robot information at the same level of detail (b) virtual information is filtered based on human-robot proxemics, only the most relevant information is presented in the AR view.
Fig. 1. Proxemic-aware augmented reality (AR) may mitigate information overloading in AR-based human-robot interaction (HRI) (a) an AR interface displays all robot information at the same level of detail (b) virtual information is filtered based on human-robot proxemics, only the most relevant information is presented in the AR view.
How This Connects
Jingyang LiuJingyang LiuHongyu MaoHongyu MaoJoshua BardJoshua BardA Computational Framework For Robotic Quality Assessment and Management In ConstructionA Computational…Towards Adaptive Additive Manufacturing Image-based Monitoring for Binder Jet 3D Printing of Coarse Composite Concrete PowdersTowards Adaptiv…Robust Visual SLAM with Integrated UWB Positioning for Construction RoboticsRobust Visual S…Towards Adaptive Additive Manufacturing with Semi-autonomous Robotic Binder Jet 3D Printing of ConcreteTowards Adaptiv…Computational design and fabrication of highly customizable architectural space frames: Making a flat-cut Weaire-Phelan structureComputational d…
Proxemic-aware Augmented Reality For Human-Robot Interaction
Open in Constellation View