Improved Situational Awareness in ROS Using Panospheric Vision and Virtual Reality. Vunder, V., Valner, R., McMahon, C., Kruusamäe, K., & Pryor, M. In 2018 11th International Conference on Human System Interaction (HSI), pages 471–477, Gdansk, Poland, July, 2018. IEEE.
doi  abstract   bibtex   
One of the main difficulties in teleoperated systems is providing an operator with sufficient Situational Awareness (SA). This paper introduces three open-source packages that improve the operator's SA using the Robot Operating System (ROS). The first package-rviz_textured_sphere-allows rendering panospheric camera outputs as spherical images in the ROS visualization software RViz. A system where the visualization of this spherical data using an open-source virtual reality (OSVR) headset in the ROS framework is achieved with the second package: rviz_plugin_osvr. Finally, the third package-pointcloud_painter-projects spherical data onto a 3D depth cloud scan of the scene generated from a rotating lidar. This package outputs a XYZRGB pointcloud that can be visualized either in RViz or using the virtual reality headset. Together, these technologies address the wider issue of limited SA in robotics and represent a substantial advancement in the environment visualization capabilities available to open-source robotics developers.
@inproceedings{vunder_improved_2018,
	address = {Gdansk, Poland},
	title = {Improved {Situational} {Awareness} in {ROS} {Using} {Panospheric} {Vision} and {Virtual} {Reality}},
	doi = {10.1109/HSI.2018.8431062},
	abstract = {One of the main difficulties in teleoperated systems is providing an operator with sufficient Situational Awareness (SA). This paper introduces three open-source packages that improve the operator's SA using the Robot Operating System (ROS). The first package-rviz\_textured\_sphere-allows rendering panospheric camera outputs as spherical images in the ROS visualization software RViz. A system where the visualization of this spherical data using an open-source virtual reality (OSVR) headset in the ROS framework is achieved with the second package: rviz\_plugin\_osvr. Finally, the third package-pointcloud\_painter-projects spherical data onto a 3D depth cloud scan of the scene generated from a rotating lidar. This package outputs a XYZRGB pointcloud that can be visualized either in RViz or using the virtual reality headset. Together, these technologies address the wider issue of limited SA in robotics and represent a substantial advancement in the environment visualization capabilities available to open-source robotics developers.},
	booktitle = {2018 11th {International} {Conference} on {Human} {System} {Interaction} ({HSI})},
	publisher = {IEEE},
	author = {Vunder, Veiko and Valner, Robert and McMahon, Conor and Kruusamäe, Karl and Pryor, Mitch},
	month = jul,
	year = {2018},
	keywords = {3D depth cloud scan, Cameras, Data visualization, Distortion, Headphones, Lenses, OSVR headset, ROS, ROS visualization software, RViz, Rendering (computer graphics), Robots, XYZRGB pointcloud, control engineering computing, data visualisation, environment visualization capabilities, human-robot interaction, lidar, mobile robots, open-source packages, open-source robotics developers, open-source virtual reality headset, operating systems (computers), optical radar, package-rviz\_textured\_sphere, panospheric camera output rendering, panospheric vision, pointcloud\_painter-projects spherical data, public domain software, rendering (computer graphics), robot operating system, rviz\_plugin\_osvr, situational awareness, spherical images, teleoperated systems, telerobotics, user interfaces, virtual reality},
	pages = {471--477},
}

Downloads: 0