Natural Language Command of an Autonomous Micro-Air Vehicle. Huang, A., S., Tellex, S., Bachrach, A., Kollar, T., Roy, D., & Roy, N.
Natural Language Command of an Autonomous Micro-Air Vehicle [pdf]Paper  abstract   bibtex   
— Natural language is a flexible and intuitive modal-ity for conveying directions and commands to a robot but presents a number of computational challenges. Diverse words and phrases must be mapped into structures that the robot can understand, and elements in those structures must be grounded in an uncertain environment. In this paper we present a micro-air vehicle (MAV) capable of following natural language directions through a previously mapped and labeled environment. We extend our previous work in understanding 2D natural language directions to three dimensions, accommodating new verb modifiers such as go up and go down, and commands such as turn around and face the windows. We demonstrate the robot following directions created by a human for another human, and interactively executing commands in the context of surveillance and search and rescue in confined spaces. In an informal study, 71% of the paths computed from directions given by one user terminated within 10 m of the desired destination.
@article{
 title = {Natural Language Command of an Autonomous Micro-Air Vehicle},
 type = {article},
 id = {8c013f98-1b94-33a1-b6d2-cb9ba3eaf45c},
 created = {2017-09-01T15:53:50.854Z},
 file_attached = {true},
 profile_id = {80da7853-f7b7-36a9-8e4c-d7ddb2d9e538},
 group_id = {a2333ea3-15a4-3d40-8d36-f0d9590ca926},
 last_modified = {2017-09-01T15:53:51.007Z},
 read = {false},
 starred = {false},
 authored = {false},
 confirmed = {false},
 hidden = {false},
 abstract = {— Natural language is a flexible and intuitive modal-ity for conveying directions and commands to a robot but presents a number of computational challenges. Diverse words and phrases must be mapped into structures that the robot can understand, and elements in those structures must be grounded in an uncertain environment. In this paper we present a micro-air vehicle (MAV) capable of following natural language directions through a previously mapped and labeled environment. We extend our previous work in understanding 2D natural language directions to three dimensions, accommodating new verb modifiers such as go up and go down, and commands such as turn around and face the windows. We demonstrate the robot following directions created by a human for another human, and interactively executing commands in the context of surveillance and search and rescue in confined spaces. In an informal study, 71% of the paths computed from directions given by one user terminated within 10 m of the desired destination.},
 bibtype = {article},
 author = {Huang, Albert S and Tellex, Stefanie and Bachrach, Abraham and Kollar, Thomas and Roy, Deb and Roy, Nicholas}
}
Downloads: 0