Toward Supervised Reinforcement Learning with Partial States for Social HRI

Toward Supervised Reinforcement Learning with Partial States for Social HRI . Senft, E., Lemaignan, S., Baxter, P., & Belpaeme, T. In 4th AAAI FSS on Artificial Intelligence for Social Human-Robot Interaction (AI-HRI), Arlington, VA, USA, 2017.

Paper abstract bibtex

Social interacting is a complex task for which machine learning holds particular promise. However, as no sufficiently accurate simulator of human interactions exists today, the learning of social interaction strategies has to happen online in the real world. Actions executed by the robot impact on humans, and as such have to be carefully selected, making it impossible to rely on random exploration. Additionally, no clear reward function exists for social interactions. This implies that traditional approaches used for Reinforcement Learning cannot be directly applied for learning how to interact with the social world. As such we argue that robots will profit from human expertise and guidance to learn social interactions. However, as the quantity of input a human can provide is limited, new methods have to be designed to use human input more efficiently. In this paper we describe a setup in which we combine a framework called Supervised Progressively Autonomous Robot Competencies (SPARC), which allows safer online learning with Reinforcement Learning, with the use of partial states rather than full states to accelerate generalisation and obtain a usable action policy more quickly

@inproceedings{Senft2017b,
    abstract={Social interacting is a complex task for which machine learning holds particular promise. However, as no sufficiently accurate simulator of human interactions exists today, the learning of social interaction strategies has to happen online in the real world. Actions executed by the robot impact on humans, and as such have to be carefully selected, making it impossible to rely on random exploration. Additionally, no clear reward function exists for social interactions. This implies that traditional approaches used for Reinforcement Learning cannot be directly applied for learning how to interact with the social world. As such we argue that robots will profit from human expertise and guidance to learn social interactions. However, as the quantity of input a human can provide is limited, new methods have to be designed to use human input more efficiently. In this paper we describe a setup in which we combine a framework called Supervised Progressively Autonomous Robot Competencies (SPARC), which allows safer online learning with Reinforcement Learning, with the use of partial states rather than full states to accelerate generalisation and obtain a usable action policy more quickly},
    address = {Arlington, VA, USA},
    author={Senft, Emmanuel and Lemaignan, Severin and Baxter, Paul and Belpaeme, Tony},
    booktitle={4th AAAI FSS on Artificial Intelligence for Social Human-Robot Interaction (AI-HRI)},
    title={Toward Supervised Reinforcement Learning with Partial States for Social HRI },
    url={https://ai-hri.github.io/2017/},
    year={2017},
}

Downloads: 0

{"_id":"q7Y2QnR2Wikvbdbsc","bibbaseid":"senft-lemaignan-baxter-belpaeme-towardsupervisedreinforcementlearningwithpartialstatesforsocialhri-2017","downloads":0,"creationDate":"2017-09-12T09:28:27.960Z","title":"Toward Supervised Reinforcement Learning with Partial States for Social HRI ","author_short":["Senft, E.","Lemaignan, S.","Baxter, P.","Belpaeme, T."],"year":2017,"bibtype":"inproceedings","biburl":"https://paul-baxter.github.io/baxter-publications.bib","bibdata":{"bibtype":"inproceedings","type":"inproceedings","abstract":"Social interacting is a complex task for which machine learning holds particular promise. However, as no sufficiently accurate simulator of human interactions exists today, the learning of social interaction strategies has to happen online in the real world. Actions executed by the robot impact on humans, and as such have to be carefully selected, making it impossible to rely on random exploration. Additionally, no clear reward function exists for social interactions. This implies that traditional approaches used for Reinforcement Learning cannot be directly applied for learning how to interact with the social world. As such we argue that robots will profit from human expertise and guidance to learn social interactions. However, as the quantity of input a human can provide is limited, new methods have to be designed to use human input more efficiently. In this paper we describe a setup in which we combine a framework called Supervised Progressively Autonomous Robot Competencies (SPARC), which allows safer online learning with Reinforcement Learning, with the use of partial states rather than full states to accelerate generalisation and obtain a usable action policy more quickly","address":"Arlington, VA, USA","author":[{"propositions":[],"lastnames":["Senft"],"firstnames":["Emmanuel"],"suffixes":[]},{"propositions":[],"lastnames":["Lemaignan"],"firstnames":["Severin"],"suffixes":[]},{"propositions":[],"lastnames":["Baxter"],"firstnames":["Paul"],"suffixes":[]},{"propositions":[],"lastnames":["Belpaeme"],"firstnames":["Tony"],"suffixes":[]}],"booktitle":"4th AAAI FSS on Artificial Intelligence for Social Human-Robot Interaction (AI-HRI)","title":"Toward Supervised Reinforcement Learning with Partial States for Social HRI ","url":"https://ai-hri.github.io/2017/","year":"2017","bibtex":"@inproceedings{Senft2017b,\n abstract={Social interacting is a complex task for which machine learning holds particular promise. However, as no sufficiently accurate simulator of human interactions exists today, the learning of social interaction strategies has to happen online in the real world. Actions executed by the robot impact on humans, and as such have to be carefully selected, making it impossible to rely on random exploration. Additionally, no clear reward function exists for social interactions. This implies that traditional approaches used for Reinforcement Learning cannot be directly applied for learning how to interact with the social world. As such we argue that robots will profit from human expertise and guidance to learn social interactions. However, as the quantity of input a human can provide is limited, new methods have to be designed to use human input more efficiently. In this paper we describe a setup in which we combine a framework called Supervised Progressively Autonomous Robot Competencies (SPARC), which allows safer online learning with Reinforcement Learning, with the use of partial states rather than full states to accelerate generalisation and obtain a usable action policy more quickly},\n address = {Arlington, VA, USA},\n author={Senft, Emmanuel and Lemaignan, Severin and Baxter, Paul and Belpaeme, Tony},\n booktitle={4th AAAI FSS on Artificial Intelligence for Social Human-Robot Interaction (AI-HRI)},\n title={Toward Supervised Reinforcement Learning with Partial States for Social HRI },\n url={https://ai-hri.github.io/2017/},\n year={2017},\n}\n\n","author_short":["Senft, E.","Lemaignan, S.","Baxter, P.","Belpaeme, T."],"key":"Senft2017b","id":"Senft2017b","bibbaseid":"senft-lemaignan-baxter-belpaeme-towardsupervisedreinforcementlearningwithpartialstatesforsocialhri-2017","role":"author","urls":{"Paper":"https://ai-hri.github.io/2017/"},"metadata":{"authorlinks":{"baxter, p":"https://paul-baxter.github.io/"}},"downloads":0},"search_terms":["toward","supervised","reinforcement","learning","partial","states","social","hri","senft","lemaignan","baxter","belpaeme"],"keywords":[],"authorIDs":["5739bcfce0085c3117000190","5e040b600fe3b7df01000043","5e656deade41b9df0100014c","A3mGhS2SbhJYnk5yu","Cji9G2ehi4M3nF97N","W43S8HiGYvhDY9iZd","dsLP3GZfAMoJMMuLF","xriM4i228CywAcm3k","zsEqhRuj6jX3jPcyX"],"dataSources":["CynghfDCEH5bQpnEL","uQbvPKnFsvnYsrrEz"]}