Towards Improving Experimentation in Software Engineering

Edson Oliveirajr, Viviane Furtado, Henrique Vignando, Carlos Luz, André Cordeiro, Igor Steinmacher, Avelino Zorzo

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

[Background:] Experimentation in Software Engineering plays a central role on sharing and verifying scientific findings. As experiments have increased significantly in Software Engineering area, we observe that most of them fail to provide a way to be repeated, replicated or reproduced, thus jeopardizing or delaying the evolution of the Software Engineering area. [Aims:] In this vision paper, we present and discuss techniques and infrastructure to continuously improve experiments towards repeatability, replicability, and reproducibility. [Method:] We define these techniques and infrastructure based on experiences of our research groups and existing literature. Furthermore, we follow Open Science principles. [Results:] We provide incipient results and foresee a central infrastructure composed of two repositories and two recommendation systems to support techniques for: reporting experiments; developing ontologies for experiments and open educational resources; mining and recommending experiments; specifying data management plans, identifying families of experiments; and teaching and learning experimentation. [Conclusions:] Our techniques and infrastructure will prospectively motivate and benefit Software Engineering evolution by improving the conduction and further reproducibility of experiments.

Original languageEnglish (US)
Title of host publicationCBSOFT 2021 - Brazilian Conference on Software; Proceedings - 35th Brazilian Symposium on Software Engineering, SBES 2021
PublisherAssociation for Computing Machinery
Pages335-340
Number of pages6
ISBN (Electronic)9781450390613
DOIs
StatePublished - Sep 27 2021
Externally publishedYes
Event35th Brazilian Symposium on Software Engineering, SBES 2021, held in conjunction with the Brazilian Conference on Software: Theory and Practice, CBSoft 2021 - Virtual, Online, Brazil
Duration: Sep 29 2021Oct 1 2021

Publication series

NameACM International Conference Proceeding Series

Conference

Conference35th Brazilian Symposium on Software Engineering, SBES 2021, held in conjunction with the Brazilian Conference on Software: Theory and Practice, CBSoft 2021
Country/TerritoryBrazil
CityVirtual, Online
Period9/29/2110/1/21

Keywords

  • Continuous Experimentation
  • Data Management Plans
  • Experimentation Improvement
  • Ontology
  • Recommender Systems
  • Repositories
  • Teaching/Learning

ASJC Scopus subject areas

  • Software
  • Human-Computer Interaction
  • Computer Vision and Pattern Recognition
  • Computer Networks and Communications

Fingerprint

Dive into the research topics of 'Towards Improving Experimentation in Software Engineering'. Together they form a unique fingerprint.

Cite this