A Behaviour-Driven Approach for Testing Requirements via User and System Stories in Agent Systems. Rodriguez, S., Thangarajah, J., & Winikoff, M. In Proceedings of the 2023 International Conference on Autonomous Agents and Multiagent Systems, of AAMAS '23, pages 1182–1190, Richland, SC, May, 2023. International Foundation for Autonomous Agents and Multiagent Systems.
Paper doi abstract bibtex 1 download Testing is a critical part of the software development cycle. This is even more important for autonomous systems, which can be challenging to test. In mainstream software engineering, Behaviour-Driven Development (BDD) is an Agile software development practice that is well accepted and widely used. It involves defining test cases for the expected system behaviour prior to developing the associated functionality. In this work, we present a BDD approach to testing the behavioural requirements of an agent system specified via User and System Stories (USS). USS is also based on established Agile processes and is shown to be intuitive and readily mapped to agent concepts. More specifically we extend USS so that they can be used for testing, and develop a behaviour-driven testing framework based on USS. We show how test cases can be developed, and how to evaluate the test cases by using a state-of-the-art mutation testing system, PITest, which we have integrated into our test framework. A key feature of our work is that we leverage a range of state-of-the-art development tools, inheriting the rich set of features they provide.
@inproceedings{Rodriguez2023BDD,
address = {Richland, SC},
series = {{AAMAS} '23},
title = {A {Behaviour}-{Driven} {Approach} for {Testing} {Requirements} via {User} and {System} {Stories} in {Agent} {Systems}},
isbn = {978-1-4503-9432-1},
url = {https://www.southampton.ac.uk/~eg/AAMAS2023/pdfs/p1182.pdf},
doi = {10.5555/3545946.3598761},
abstract = {Testing is a critical part of the software development cycle. This is even more important for autonomous systems, which can be challenging to test. In mainstream software engineering, Behaviour-Driven Development (BDD) is an Agile software development practice that is well accepted and widely used. It involves defining test cases for the expected system behaviour prior to developing the associated functionality. In this work, we present a BDD approach to testing the behavioural requirements of an agent system specified via User and System Stories (USS). USS is also based on established Agile processes and is shown to be intuitive and readily mapped to agent concepts. More specifically we extend USS so that they can be used for testing, and develop a behaviour-driven testing framework based on USS. We show how test cases can be developed, and how to evaluate the test cases by using a state-of-the-art mutation testing system, PITest, which we have integrated into our test framework. A key feature of our work is that we leverage a range of state-of-the-art development tools, inheriting the rich set of features they provide.},
urldate = {2023-10-16},
booktitle = {Proceedings of the 2023 {International} {Conference} on {Autonomous} {Agents} and {Multiagent} {Systems}},
publisher = {International Foundation for Autonomous Agents and Multiagent Systems},
author = {Rodriguez, Sebastian and Thangarajah, John and Winikoff, Michael},
month = may,
year = {2023},
keywords = {AOSE, behaviour-driven development, requirements testing, system stories, test-driven development testing, user stories},
pages = {1182--1190},
}
Downloads: 1
{"_id":"RGSHNqLYTDDAK9WyE","bibbaseid":"rodriguez-thangarajah-winikoff-abehaviourdrivenapproachfortestingrequirementsviauserandsystemstoriesinagentsystems-2023","author_short":["Rodriguez, S.","Thangarajah, J.","Winikoff, M."],"bibdata":{"bibtype":"inproceedings","type":"inproceedings","address":"Richland, SC","series":"AAMAS '23","title":"A Behaviour-Driven Approach for Testing Requirements via User and System Stories in Agent Systems","isbn":"978-1-4503-9432-1","url":"https://www.southampton.ac.uk/~eg/AAMAS2023/pdfs/p1182.pdf","doi":"10.5555/3545946.3598761","abstract":"Testing is a critical part of the software development cycle. This is even more important for autonomous systems, which can be challenging to test. In mainstream software engineering, Behaviour-Driven Development (BDD) is an Agile software development practice that is well accepted and widely used. It involves defining test cases for the expected system behaviour prior to developing the associated functionality. In this work, we present a BDD approach to testing the behavioural requirements of an agent system specified via User and System Stories (USS). USS is also based on established Agile processes and is shown to be intuitive and readily mapped to agent concepts. More specifically we extend USS so that they can be used for testing, and develop a behaviour-driven testing framework based on USS. We show how test cases can be developed, and how to evaluate the test cases by using a state-of-the-art mutation testing system, PITest, which we have integrated into our test framework. A key feature of our work is that we leverage a range of state-of-the-art development tools, inheriting the rich set of features they provide.","urldate":"2023-10-16","booktitle":"Proceedings of the 2023 International Conference on Autonomous Agents and Multiagent Systems","publisher":"International Foundation for Autonomous Agents and Multiagent Systems","author":[{"propositions":[],"lastnames":["Rodriguez"],"firstnames":["Sebastian"],"suffixes":[]},{"propositions":[],"lastnames":["Thangarajah"],"firstnames":["John"],"suffixes":[]},{"propositions":[],"lastnames":["Winikoff"],"firstnames":["Michael"],"suffixes":[]}],"month":"May","year":"2023","keywords":"AOSE, behaviour-driven development, requirements testing, system stories, test-driven development testing, user stories","pages":"1182–1190","bibtex":"@inproceedings{Rodriguez2023BDD,\n\taddress = {Richland, SC},\n\tseries = {{AAMAS} '23},\n\ttitle = {A {Behaviour}-{Driven} {Approach} for {Testing} {Requirements} via {User} and {System} {Stories} in {Agent} {Systems}},\n\tisbn = {978-1-4503-9432-1},\n\turl = {https://www.southampton.ac.uk/~eg/AAMAS2023/pdfs/p1182.pdf},\n\tdoi = {10.5555/3545946.3598761},\n\tabstract = {Testing is a critical part of the software development cycle. This is even more important for autonomous systems, which can be challenging to test. In mainstream software engineering, Behaviour-Driven Development (BDD) is an Agile software development practice that is well accepted and widely used. It involves defining test cases for the expected system behaviour prior to developing the associated functionality. In this work, we present a BDD approach to testing the behavioural requirements of an agent system specified via User and System Stories (USS). USS is also based on established Agile processes and is shown to be intuitive and readily mapped to agent concepts. More specifically we extend USS so that they can be used for testing, and develop a behaviour-driven testing framework based on USS. We show how test cases can be developed, and how to evaluate the test cases by using a state-of-the-art mutation testing system, PITest, which we have integrated into our test framework. A key feature of our work is that we leverage a range of state-of-the-art development tools, inheriting the rich set of features they provide.},\n\turldate = {2023-10-16},\n\tbooktitle = {Proceedings of the 2023 {International} {Conference} on {Autonomous} {Agents} and {Multiagent} {Systems}},\n\tpublisher = {International Foundation for Autonomous Agents and Multiagent Systems},\n\tauthor = {Rodriguez, Sebastian and Thangarajah, John and Winikoff, Michael},\n\tmonth = may,\n\tyear = {2023},\n\tkeywords = {AOSE, behaviour-driven development, requirements testing, system stories, test-driven development testing, user stories},\n\tpages = {1182--1190},\n}\n\n","author_short":["Rodriguez, S.","Thangarajah, J.","Winikoff, M."],"key":"Rodriguez2023BDD","id":"Rodriguez2023BDD","bibbaseid":"rodriguez-thangarajah-winikoff-abehaviourdrivenapproachfortestingrequirementsviauserandsystemstoriesinagentsystems-2023","role":"author","urls":{"Paper":"https://www.southampton.ac.uk/~eg/AAMAS2023/pdfs/p1182.pdf"},"keyword":["AOSE","behaviour-driven development","requirements testing","system stories","test-driven development testing","user stories"],"metadata":{"authorlinks":{}},"downloads":1},"bibtype":"inproceedings","biburl":"https://api.zotero.org/users/629018/collections/CB9YK5F5/items?key=7FwOYSA57XqwE4i5WOHIlvZZ&format=bibtex&limit=100","dataSources":["dpS26Nm5wBb9pZTfk","2xjJWWKzozqCYv3fA"],"keywords":["aose","behaviour-driven development","requirements testing","system stories","test-driven development testing","user stories"],"search_terms":["behaviour","driven","approach","testing","requirements","via","user","system","stories","agent","systems","rodriguez","thangarajah","winikoff"],"title":"A Behaviour-Driven Approach for Testing Requirements via User and System Stories in Agent Systems","year":2023,"downloads":1}