Alice in DIY wonderland or: Instructing novice users on how to use tools in DIY projects

Alice in DIY wonderland or: Instructing novice users on how to use tools in DIY projects. Behnke, G., Schiller, M., Kraus, M., Bercher, P., Schmautz, M., Dorna, M., Dambier, M., Minker, W., Glimm, B., & Biundo, S. AI Communications, 32(1):31–57, IOS Press, 2019.

Paper

Alice in DIY wonderland or: Instructing novice users on how to use tools in DIY projects [link]

Domain-model doi abstract bibtex 9 downloads

We present the interactive assistant R OBERT that provides situation-adaptive support in the realisation of do-it-yourself (DIY) home improvement projects. ROBERT assists its users by providing comprehensive step-by-step instructions for completing the DIY project. Each instruction is illustrated with detailed graphics, written and spoken text, as well as with videos. They explain how the steps of the project have to be prepared and assembled and give precise instructions on how to operate the required electric devices. The step-by-step instructions are generated by a hierarchical planner, which enables ROBERT to adapt to a multitude of environments easily. Parts of the underlying model are derived from an ontology storing information about the available devices and resources. A dialogue manager capable of natural language interaction is responsible for hands-free interaction. We explain the required background technology and present preliminary results of an empirical evaluation.

@Article{Behnke2019DIYWonderland,
  author           = {Behnke, Gregor and Schiller, Marvin and Kraus, Matthias and Pascal Bercher and Schmautz, Mario and Dorna, Michael and Dambier, Michael and Minker, Wolfgang and Glimm, Birte and Biundo, Susanne},
  title            = {Alice in {DIY} wonderland or: Instructing novice users on how to use tools in {DIY} projects},
  journal          = {AI Communications},
  year             = {2019},
  publisher        = {IOS Press},
  doi              = {10.3233/AIC-180604},
  volume           = {32},
  number           = {1},
  pages            = {31--57},
  abstract         = {We present the interactive assistant R OBERT that provides situation-adaptive support in the realisation of do-it-yourself (DIY) home improvement projects. ROBERT assists its users by providing comprehensive step-by-step instructions for completing the DIY project. Each instruction is illustrated with detailed graphics, written and spoken text, as well as with videos. They explain how the steps of the project have to be prepared and assembled and give precise instructions on how to operate the required electric devices. The step-by-step instructions are generated by a hierarchical planner, which enables ROBERT to adapt to a multitude of environments easily. Parts of the underlying model are derived from an ontology storing information about the available devices and resources. A dialogue manager capable of natural language interaction is responsible for hands-free interaction. We explain the required background technology and present preliminary results of an empirical evaluation.},
  url_Paper        = {https://bercher.net/publications/2019/Behnke2019DIYWonderland.pdf},
  url_domain-model = {https://bercher.net/publications/2019/Behnke2019DIYWonderlandDomain.zip},
  keywords         = {article}
}

Downloads: 9