Towards Bridging the Gap between High-Level Reasoning and Execution on Robots. Hofmann, T. Ph.D. Thesis, RWTH Aachen University, Aachen, Germany, 2023. Paper abstract bibtex 9 downloads When reasoning about actions, e.g., by means of task planning or agent programming with Golog, the robot's actions are typically modeled on an abstract level, where complex actions such as picking up an object are treated as atomic primitives with deterministic effects and preconditions that only depend on the current state. However, when executing such an action on a robot it can no longer be seen as a primitive. Instead, action execution is a complex task involving multiple steps with additional temporal preconditions and timing constraints. Furthermore, the action may be noisy, e.g., producing erroneous sensing results and not always having the desired effects. While these aspects are typically ignored in reasoning tasks, they need to be dealt with during execution. In this thesis, we propose several approaches towards closing this gap. Based on a logic that combines the situation calculus with metric time and metric temporal logic, we model the robot platform with timed automata and temporal constraints to describe the connection between the high-level actions and the robot platform. We then describe two approaches towards transforming the high-level program. First, we view the transformation as a synthesis problem, where the task is to synthesize a controller that executes the program while satisfying the specification, independent of the environment's choices. We show that the synthesis problem is decidable, describe an algorithm to construct a controller, and evaluate the approach in two robotics scenarios. While this approach supports controlling arbitrary Golog programs against any specification with timing constraints, it does not scale well. For this reason, we describe a second approach based on some simplifying assumptions which allow us to view the transformation problem as a reachability problem on timed automata, which can be solved with state-of-the-art tools. We demonstrate the effectiveness and scalability of the approach in a number of scenarios. Finally, we turn towards noisy sensors and effectors. Based on DS, a probabilistic variant of the situation calculus that allows modeling the agent's degree of belief, we describe an abstraction framework for Golog programs with noisy actions. In this framework, a high-level and non-stochastic program is mapped to a more detailed and stochastic low-level program. As the high-level program is non-stochastic, we may use non-probabilistic reasoning methods such as task planning or classical Golog program execution. At the same time, by mapping the abstract actions to low-level programs, we may still deal with uncertainty during execution. We define a suitable notion of bisimulation that guarantees the equivalence between the high-level and low-level programs and demonstrate the approach with an example.
@phdthesis{hofmannBridgingGapHighlevel2023,
title = {Towards Bridging the Gap between High-Level Reasoning and Execution on Robots},
author = {Hofmann, Till},
year = {2023},
address = {{Aachen, Germany}},
url = {https://doi.org/10.18154/RWTH-2023-10508},
abstract = {When reasoning about actions, e.g., by means of task planning or agent programming with Golog, the robot's actions are typically modeled on an abstract level, where complex actions such as picking up an object are treated as atomic primitives with deterministic effects and preconditions that only depend on the current state. However, when executing such an action on a robot it can no longer be seen as a primitive. Instead, action execution is a complex task involving multiple steps with additional temporal preconditions and timing constraints. Furthermore, the action may be noisy, e.g., producing erroneous sensing results and not always having the desired effects. While these aspects are typically ignored in reasoning tasks, they need to be dealt with during execution. In this thesis, we propose several approaches towards closing this gap. Based on a logic that combines the situation calculus with metric time and metric temporal logic, we model the robot platform with timed automata and temporal constraints to describe the connection between the high-level actions and the robot platform. We then describe two approaches towards transforming the high-level program. First, we view the transformation as a synthesis problem, where the task is to synthesize a controller that executes the program while satisfying the specification, independent of the environment's choices. We show that the synthesis problem is decidable, describe an algorithm to construct a controller, and evaluate the approach in two robotics scenarios. While this approach supports controlling arbitrary Golog programs against any specification with timing constraints, it does not scale well. For this reason, we describe a second approach based on some simplifying assumptions which allow us to view the transformation problem as a reachability problem on timed automata, which can be solved with state-of-the-art tools. We demonstrate the effectiveness and scalability of the approach in a number of scenarios. Finally, we turn towards noisy sensors and effectors. Based on DS, a probabilistic variant of the situation calculus that allows modeling the agent's degree of belief, we describe an abstraction framework for Golog programs with noisy actions. In this framework, a high-level and non-stochastic program is mapped to a more detailed and stochastic low-level program. As the high-level program is non-stochastic, we may use non-probabilistic reasoning methods such as task planning or classical Golog program execution. At the same time, by mapping the abstract actions to low-level programs, we may still deal with uncertainty during execution. We define a suitable notion of bisimulation that guarantees the equivalence between the high-level and low-level programs and demonstrate the approach with an example.},
school = {RWTH Aachen University},
keywords = {artificial intelligence,belief-based programs,cognitive robotics,Golog,knowledge representation,metric temporal logic,situation calculus,stochastic actions,synthesis,timed systems,verification}
}
Downloads: 9
{"_id":"mMH7GN5CySYCpKZi9","bibbaseid":"hofmann-towardsbridgingthegapbetweenhighlevelreasoningandexecutiononrobots-2023","author_short":["Hofmann, T."],"bibdata":{"bibtype":"phdthesis","type":"phdthesis","title":"Towards Bridging the Gap between High-Level Reasoning and Execution on Robots","author":[{"propositions":[],"lastnames":["Hofmann"],"firstnames":["Till"],"suffixes":[]}],"year":"2023","address":"Aachen, Germany","url":"https://doi.org/10.18154/RWTH-2023-10508","abstract":"When reasoning about actions, e.g., by means of task planning or agent programming with Golog, the robot's actions are typically modeled on an abstract level, where complex actions such as picking up an object are treated as atomic primitives with deterministic effects and preconditions that only depend on the current state. However, when executing such an action on a robot it can no longer be seen as a primitive. Instead, action execution is a complex task involving multiple steps with additional temporal preconditions and timing constraints. Furthermore, the action may be noisy, e.g., producing erroneous sensing results and not always having the desired effects. While these aspects are typically ignored in reasoning tasks, they need to be dealt with during execution. In this thesis, we propose several approaches towards closing this gap. Based on a logic that combines the situation calculus with metric time and metric temporal logic, we model the robot platform with timed automata and temporal constraints to describe the connection between the high-level actions and the robot platform. We then describe two approaches towards transforming the high-level program. First, we view the transformation as a synthesis problem, where the task is to synthesize a controller that executes the program while satisfying the specification, independent of the environment's choices. We show that the synthesis problem is decidable, describe an algorithm to construct a controller, and evaluate the approach in two robotics scenarios. While this approach supports controlling arbitrary Golog programs against any specification with timing constraints, it does not scale well. For this reason, we describe a second approach based on some simplifying assumptions which allow us to view the transformation problem as a reachability problem on timed automata, which can be solved with state-of-the-art tools. We demonstrate the effectiveness and scalability of the approach in a number of scenarios. Finally, we turn towards noisy sensors and effectors. Based on DS, a probabilistic variant of the situation calculus that allows modeling the agent's degree of belief, we describe an abstraction framework for Golog programs with noisy actions. In this framework, a high-level and non-stochastic program is mapped to a more detailed and stochastic low-level program. As the high-level program is non-stochastic, we may use non-probabilistic reasoning methods such as task planning or classical Golog program execution. At the same time, by mapping the abstract actions to low-level programs, we may still deal with uncertainty during execution. We define a suitable notion of bisimulation that guarantees the equivalence between the high-level and low-level programs and demonstrate the approach with an example.","school":"RWTH Aachen University","keywords":"artificial intelligence,belief-based programs,cognitive robotics,Golog,knowledge representation,metric temporal logic,situation calculus,stochastic actions,synthesis,timed systems,verification","bibtex":"@phdthesis{hofmannBridgingGapHighlevel2023,\n title = {Towards Bridging the Gap between High-Level Reasoning and Execution on Robots},\n author = {Hofmann, Till},\n year = {2023},\n address = {{Aachen, Germany}},\n url = {https://doi.org/10.18154/RWTH-2023-10508},\n abstract = {When reasoning about actions, e.g., by means of task planning or agent programming with Golog, the robot's actions are typically modeled on an abstract level, where complex actions such as picking up an object are treated as atomic primitives with deterministic effects and preconditions that only depend on the current state. However, when executing such an action on a robot it can no longer be seen as a primitive. Instead, action execution is a complex task involving multiple steps with additional temporal preconditions and timing constraints. Furthermore, the action may be noisy, e.g., producing erroneous sensing results and not always having the desired effects. While these aspects are typically ignored in reasoning tasks, they need to be dealt with during execution. In this thesis, we propose several approaches towards closing this gap. Based on a logic that combines the situation calculus with metric time and metric temporal logic, we model the robot platform with timed automata and temporal constraints to describe the connection between the high-level actions and the robot platform. We then describe two approaches towards transforming the high-level program. First, we view the transformation as a synthesis problem, where the task is to synthesize a controller that executes the program while satisfying the specification, independent of the environment's choices. We show that the synthesis problem is decidable, describe an algorithm to construct a controller, and evaluate the approach in two robotics scenarios. While this approach supports controlling arbitrary Golog programs against any specification with timing constraints, it does not scale well. For this reason, we describe a second approach based on some simplifying assumptions which allow us to view the transformation problem as a reachability problem on timed automata, which can be solved with state-of-the-art tools. We demonstrate the effectiveness and scalability of the approach in a number of scenarios. Finally, we turn towards noisy sensors and effectors. Based on DS, a probabilistic variant of the situation calculus that allows modeling the agent's degree of belief, we describe an abstraction framework for Golog programs with noisy actions. In this framework, a high-level and non-stochastic program is mapped to a more detailed and stochastic low-level program. As the high-level program is non-stochastic, we may use non-probabilistic reasoning methods such as task planning or classical Golog program execution. At the same time, by mapping the abstract actions to low-level programs, we may still deal with uncertainty during execution. We define a suitable notion of bisimulation that guarantees the equivalence between the high-level and low-level programs and demonstrate the approach with an example.},\n school = {RWTH Aachen University},\n keywords = {artificial intelligence,belief-based programs,cognitive robotics,Golog,knowledge representation,metric temporal logic,situation calculus,stochastic actions,synthesis,timed systems,verification}\n}\n\n","author_short":["Hofmann, T."],"key":"hofmannBridgingGapHighlevel2023","id":"hofmannBridgingGapHighlevel2023","bibbaseid":"hofmann-towardsbridgingthegapbetweenhighlevelreasoningandexecutiononrobots-2023","role":"author","urls":{"Paper":"https://doi.org/10.18154/RWTH-2023-10508"},"keyword":["artificial intelligence","belief-based programs","cognitive robotics","Golog","knowledge representation","metric temporal logic","situation calculus","stochastic actions","synthesis","timed systems","verification"],"metadata":{"authorlinks":{}},"downloads":9},"bibtype":"phdthesis","biburl":"https://kbsg.rwth-aachen.de/files/kbsgweb.bib","dataSources":["dqRQPSg6Hy3ZXQg7z","bTnDYS5vwPW5Supsu","tf5mTExTEFXuErEdH"],"keywords":["artificial intelligence","belief-based programs","cognitive robotics","golog","knowledge representation","metric temporal logic","situation calculus","stochastic actions","synthesis","timed systems","verification"],"search_terms":["towards","bridging","gap","between","high","level","reasoning","execution","robots","hofmann"],"title":"Towards Bridging the Gap between High-Level Reasoning and Execution on Robots","year":2023,"downloads":10}