Causal Distance-Metric-Based Assistance for Debugging after Compiler Fuzzing

Josie Holmes, Alex Groce

Research output: Chapter in Book/Report/Conference proceedingConference contribution

16 Scopus citations

Abstract

Measuring the distance between two program executions is a fundamental problem in dynamic analysis of software, and useful in many test generation and debugging algorithms. This paper proposes a metric for measuring distance between executions, and specializes it to an important application: determining similarity of failing test cases for the purpose of automated fault identification and localization in debugging based on automatically generated compiler tests. The metric is based on a causal concept of distance where executions are similar to the degree that changes in the program itself, introduced by mutation, cause similar changes in the correctness of the executions. Specifically, if two failing test cases (for the original compiler) become successful due to the same mutant, they are more likely to be due to the same fault. We evaluate our metric using more than 50 faults and 2,800 test cases for two widely-used real-world compilers, and demonstrate improvements over state-of-the-art methods for fault identification and localization.

Original languageEnglish (US)
Title of host publicationProceedings - 29th IEEE International Symposium on Software Reliability Engineering, ISSRE 2018
EditorsSudipto Ghosh, Bojan Cukic, Robin Poston, Roberto Natella, Nuno Laranjeiro
PublisherIEEE Computer Society
Pages166-177
Number of pages12
ISBN (Electronic)9781538683217
DOIs
StatePublished - Nov 16 2018
Externally publishedYes
Event29th IEEE International Symposium on Software Reliability Engineering, ISSRE 2018 - Memphis, United States
Duration: Oct 15 2018Oct 18 2018

Publication series

NameProceedings - International Symposium on Software Reliability Engineering, ISSRE
Volume2018-October
ISSN (Print)1071-9458

Conference

Conference29th IEEE International Symposium on Software Reliability Engineering, ISSRE 2018
Country/TerritoryUnited States
CityMemphis
Period10/15/1810/18/18

Keywords

  • Compiler testing
  • Debugging
  • Distance metrics
  • Fault identification
  • Fault localization
  • Mutation analysis

ASJC Scopus subject areas

  • Software
  • Safety, Risk, Reliability and Quality

Fingerprint

Dive into the research topics of 'Causal Distance-Metric-Based Assistance for Debugging after Compiler Fuzzing'. Together they form a unique fingerprint.

Cite this