Generating Source Inputs for Metamorphic Testing Using Dynamic Symbolic Execution. Alatawi, E., Miller, T., & Søndergaard, H. In MET'16: Proceedings of the First International Workshop on Metamorphic Testing, pages 19–25, 2016. ACM.
doi  abstract   bibtex   
Metamorphic testing uses domain-specific properties about a program's intended behaviour to alleviate the oracle problem. From a given set of source test inputs, a set of follow-up test inputs are generated which have some relation to the source inputs, and their outputs are compared to outputs from the source tests, using metamorphic relations. We evaluate the use of an automated test input generation technique called dynamic symbolic execution (DSE) to generate the source test inputs for metamorphic testing. We investigate whether DSE increases source-code coverage and fault finding effectiveness of metamorphic testing compared to the use of random testing, and whether the use of metamorphic relations as a supportive technique improves the test inputs generated by DSE. Our results show that DSE improves the coverage and fault detection rate of metamorphic testing compared to random testing using significantly smaller test suites, and the use of metamorphic relations increases code coverage of both DSE and random tests considerably, but the improvement in the fault detection rate may be marginal and depends on the used metamorphic relations.
@inproceedings{Ala-Mil-Son_MET16,
  author    = {Eman Alatawi and 
		Tim Miller and 
		Harald S{\o}ndergaard},
  title     = {Generating Source Inputs for Metamorphic Testing
                Using Dynamic Symbolic Execution},
  booktitle = {MET'16: Proceedings of the First International Workshop on
                Metamorphic Testing},
  pages     = {19--25},
  publisher = {ACM},
  year      = {2016},
  doi       = {10.1145/2896971.2896980},
  isbn      = {978-1-4503-4163-9},
  abstract  = {Metamorphic testing uses domain-specific properties about
                a program's intended behaviour to alleviate the oracle
                problem. From a given set of source test inputs, a set of
                follow-up test inputs are generated which have some
                relation to the source inputs, and their outputs are
                compared to outputs from the source tests, using
                metamorphic relations.  We evaluate the use of an
                automated test input generation technique called dynamic
                symbolic execution (DSE) to generate the source test
                inputs for metamorphic testing. We investigate whether
                DSE increases source-code coverage and fault finding
                effectiveness of metamorphic testing compared to the use
                of random testing, and whether the use of metamorphic
                relations as a supportive technique improves the test
                inputs generated by DSE. Our results show that DSE
                improves the coverage and fault detection rate of
                metamorphic testing compared to random testing using
                significantly smaller test suites, and the use of
                metamorphic relations increases code coverage of both
                DSE and random tests considerably, but the improvement
                in the fault detection rate may be marginal and depends
                on the used metamorphic relations.},
  keywords  = {Symbolic execution, Testing},
}

Downloads: 0