TY - GEN
T1 - Let a thousand flowers bloom
T2 - 2021 ACM SIGPLAN International Symposium on New Ideas, New Paradigms, and Reflections on Programming and Software, Onward! 2021, co-located with SPLASH 2021
AU - Groce, Alex
N1 - Publisher Copyright:
© 2021 ACM.
PY - 2021/10/20
Y1 - 2021/10/20
N2 - Software testing is hard, and a testing problem is composed of many sub-problems with different, often conflicting, solutions. Like many real-world problems, it admits no single optimal solution, but requires dexterity, and the opportunistic combination of many partial solutions. Exploration and experiment, even by practitioners, are important in real-world critical testing efforts. An important set of research results in the field endorse and codify the value of diversity in test generation. However, our current approaches to evaluating research results arguably cut against this fundamental reality: while effective testing may need true diversity, combining many partial answers, the iron logic of the research results section often imposes a totalizing vision where authors must at least pretend to present a monolithic, unitary solution, a new "king of the hill."
AB - Software testing is hard, and a testing problem is composed of many sub-problems with different, often conflicting, solutions. Like many real-world problems, it admits no single optimal solution, but requires dexterity, and the opportunistic combination of many partial solutions. Exploration and experiment, even by practitioners, are important in real-world critical testing efforts. An important set of research results in the field endorse and codify the value of diversity in test generation. However, our current approaches to evaluating research results arguably cut against this fundamental reality: while effective testing may need true diversity, combining many partial answers, the iron logic of the research results section often imposes a totalizing vision where authors must at least pretend to present a monolithic, unitary solution, a new "king of the hill."
KW - ensemble methods
KW - research evaluation methods
KW - software testing
KW - swarm testing
KW - test diversity
KW - test length
UR - http://www.scopus.com/inward/record.url?scp=85119048357&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85119048357&partnerID=8YFLogxK
U2 - 10.1145/3486607.3486772
DO - 10.1145/3486607.3486772
M3 - Conference contribution
AN - SCOPUS:85119048357
T3 - Onward! 2021 - Proceedings of the 2021 ACM SIGPLAN International Symposium on New Ideas, New Paradigms, and Reflections on Programming and Software, co-located with SPLASH 2021
SP - 136
EP - 144
BT - Onward! 2021 - Proceedings of the 2021 ACM SIGPLAN International Symposium on New Ideas, New Paradigms, and Reflections on Programming and Software, co-located with SPLASH 2021
A2 - De Meuter, Wolfgang
A2 - Baniassad, Elisa
PB - Association for Computing Machinery, Inc
Y2 - 20 October 2021 through 22 October 2021
ER -