{"_id":"yajg2kb4M3oyoCuGb","bibbaseid":"lippi-poklukar-welle-varava-yin-marino-kragic-latentspaceroadmapforvisualactionplanningofdeformableandrigidobjectmanipulation-2020","authorIDs":["EzGtfdDdhDoqnfZcX","LrAbsg35wgHCj2eSB","QhWqagzLeLu2dTK33","WaNxrugJcW99rtxZ2","aYgtXTRLpGNrAGodW","ne6yNnpK9XTiSEDdG"],"author_short":["Lippi, M.","Poklukar, P.","Welle, M. C.","Varava, A.","Yin, H.","Marino, A.","Kragic, D."],"bibdata":{"bibtype":"conference","type":"conference","author":[{"propositions":[],"lastnames":["Lippi"],"firstnames":["M."],"suffixes":[]},{"propositions":[],"lastnames":["Poklukar"],"firstnames":["P."],"suffixes":[]},{"propositions":[],"lastnames":["Welle"],"firstnames":["M.","C."],"suffixes":[]},{"propositions":[],"lastnames":["Varava"],"firstnames":["A."],"suffixes":[]},{"propositions":[],"lastnames":["Yin"],"firstnames":["H."],"suffixes":[]},{"propositions":[],"lastnames":["Marino"],"firstnames":["A."],"suffixes":[]},{"propositions":[],"lastnames":["Kragic"],"firstnames":["D."],"suffixes":[]}],"title":"Latent space roadmap for visual action planning of deformable and rigid object manipulation","year":"2020","booktitle":"International Conference on Intelligent Robots and Systems","abstract":"We present a framework for visual action planning of complex manipulation tasks with high-dimensional state spaces such as manipulation of deformable objects. Planning is performed in a low-dimensional latent state space that embeds images. We define and implement a Latent Space Roadmap (LSR) which is a graph-based structure that globally captures the latent system dynamics. Our framework consists of two main components: a Visual Foresight Module (VFM) that generates a visual plan as a sequence of images, and an Action Proposal Network (APN) that predicts the actions between them. We show the effectiveness of the method on a simulated box stacking task as well as a T-shirt folding task performed with a real robot.","url":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=9340764","doi":"10.1109/IROS45743.2020.9340764","isbn":"978-1-7281-6212-6","pages":"5619–5626","bibtex":"@conference{\n\t11580_91478,\n\tauthor = {Lippi, M. and Poklukar, P. and Welle, M. C. and Varava, A. and Yin, H. and Marino, A. and Kragic, D.},\n\ttitle = {Latent space roadmap for visual action planning of deformable and rigid object manipulation},\n\tyear = {2020},\n\tbooktitle = {International Conference on Intelligent Robots and Systems},\n\tabstract = {We present a framework for visual action planning\r\nof complex manipulation tasks with high-dimensional state\r\nspaces such as manipulation of deformable objects. Planning is\r\nperformed in a low-dimensional latent state space that embeds\r\nimages. We define and implement a Latent Space Roadmap\r\n(LSR) which is a graph-based structure that globally captures\r\nthe latent system dynamics. Our framework consists of two\r\nmain components: a Visual Foresight Module (VFM) that\r\ngenerates a visual plan as a sequence of images, and an Action\r\nProposal Network (APN) that predicts the actions between\r\nthem. We show the effectiveness of the method on a simulated\r\nbox stacking task as well as a T-shirt folding task performed\r\nwith a real robot.},\n\turl = {https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=9340764},\n\tdoi = {10.1109/IROS45743.2020.9340764},\n\tisbn = {978-1-7281-6212-6},\t\n\tpages = {5619--5626}\n}\n","author_short":["Lippi, M.","Poklukar, P.","Welle, M. C.","Varava, A.","Yin, H.","Marino, A.","Kragic, D."],"key":"11580_91478","id":"11580_91478","bibbaseid":"lippi-poklukar-welle-varava-yin-marino-kragic-latentspaceroadmapforvisualactionplanningofdeformableandrigidobjectmanipulation-2020","role":"author","urls":{"Paper":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=9340764"},"metadata":{"authorlinks":{"yin, h":"https://navigator8972.github.io/navigator8972.github.io/publications/","lippi, m":"https://m-lippi.github.io/publications.html","marino, a":"https://bibbase.org/show?bib=https://bibbase.org/network/files/LhpEBBMAufCZxdRLG&msg=preview&fileId=LhpEBBMAufCZxdRLG"}},"downloads":0},"bibtype":"conference","biburl":"https://bibbase.org/network/files/LhpEBBMAufCZxdRLG","creationDate":"2020-07-21T14:39:12.754Z","downloads":0,"keywords":[],"search_terms":["latent","space","roadmap","visual","action","planning","deformable","rigid","object","manipulation","lippi","poklukar","welle","varava","yin","marino","kragic"],"title":"Latent space roadmap for visual action planning of deformable and rigid object manipulation","year":2020,"dataSources":["YYA4jfiKR2BsiLkFH","N5sqdHnYRirLiSvq9","PQ6yW2mLEX5KBGz6g","qyM7W3dkRX9o3Qhhu","stF936MNsbnXfQSsz","6NgPDFaCmqRP2Kc7N","RWJmxnQ8QJ5eWqEfq","a9jNc2NyyC7d58MTq","YjpAZwNicNHANadbW","9HNP8ouNgGHQfHxfN"]}