Intuitive Robot Teleoperation through Multi-Sensor Informed Mixed Reality Visual Aids
Mobile robotic systems have evolved to include sensors capable of truthfully describing robot status and operating environment as accurately and reliably as never before. This possibility is challenged by effective sensor data exploitation, because of the cognitive load an operator is exposed to, due to the large amount of data and time-dependency constraints. This paper addresses this challenge in remote-vehicle teleoperation by proposing an intuitive way to present sensor data to users by means of using mixed reality and visual aids within the user interface. We propose a method for organizing information presentation and a set of visual aids to facilitate visual communication of data in teleoperation control panels. The resulting sensor-information presentation appears coherent and intuitive, making it easier for an operator to catch and comprehend information meaning. This increases situational awareness and speeds up decision-making. Our method is implemented on a real mobile robotic system operating outdoor equipped with on-board internal and external sensors, GPS, and a reconstructed 3D graphical model provided by an assistant drone. Experimentation verified feasibility while intuitive and comprehensive visual communication was confirmed through an assessment, which encourages further developments.
Item Type | Article |
---|---|
Uncontrolled Keywords | Virtual reality and interfaces; mixed reality; human-robot interface; head mounted display; robot teleoperation; stereo vision; field robotics; telerobotics; human-robot interaction; graphical user interfaces; augmented reality; user interfaces; Virtual reality |
Subjects |
Engineering(all) Materials Science(all) Computer Science(all) |
Date Deposited | 26 Jul 2024 12:28 |
Last Modified | 26 Jul 2024 12:28 |
Explore Further
Read more research from the creator(s):
- Livatino, Salvatore
- Guastella, Dario C.
- Muscato, Giovanni
- Rinaldi, Vincenzo
- Cantelli, Luciano
- Melita, Carmelo D.
- Caniglia, Alessandro
- Mazza, Riccardo
- Padula, Gianluca
Find work associated with the faculties and division(s):
- Centre for Engineering Research
- Communications and Intelligent Systems
- School of Physics, Engineering & Computer Science
- Department of Engineering and Technology
Find other related resources: