TY - GEN
T1 - How Experimentation in Software Engineering has been taught? Survey and Research Agenda
AU - Luz, Carlos Danilo
AU - Oliveirajr, Edson
AU - Steinmacher, Igor F.
N1 - Publisher Copyright:
© 2022 ACM.
PY - 2022/6/13
Y1 - 2022/6/13
N2 - [Background:] Experimentation in Software Engineering (ESE) has increased in the last several years as a way to provide evidence by using statistical techniques. These techniques contribute to an auditable and reliable body of knowledge towards evolving a given topic. Therefore, teaching ESE becomes an essential task while disseminating and establishing an experimental culture to both academia and industry. [Aims:] In this paper we seek to understand how ESE has been taught including contents, materials used, strategies employed, and evaluation method applied. We also provide a research agenda on the subject. [Method:] We conducted a web-based questionnaire survey with 31 instructors who teach ESE. [Results:] We see several aspects, such as: ESE is mainly taught in an exclusive course; most of the materials used to teach ESE concepts are from third parties and some of them themselves; most people do not use any type of license; the core materials used to define the content of the courses are papers and books; learning management systems are most often used to share materials with students; key learning practices used are active learning, project-based learning, and problem-based learning; and most instructors assess their students with experimental projects and seminars. Based on such results, we provide and discuss a research agenda to improve teaching of ESE. [Conclusions:] This survey provides results towards planning a research agenda to improve teaching of ESE, thus benefiting instructors, researchers, and practitioners.
AB - [Background:] Experimentation in Software Engineering (ESE) has increased in the last several years as a way to provide evidence by using statistical techniques. These techniques contribute to an auditable and reliable body of knowledge towards evolving a given topic. Therefore, teaching ESE becomes an essential task while disseminating and establishing an experimental culture to both academia and industry. [Aims:] In this paper we seek to understand how ESE has been taught including contents, materials used, strategies employed, and evaluation method applied. We also provide a research agenda on the subject. [Method:] We conducted a web-based questionnaire survey with 31 instructors who teach ESE. [Results:] We see several aspects, such as: ESE is mainly taught in an exclusive course; most of the materials used to teach ESE concepts are from third parties and some of them themselves; most people do not use any type of license; the core materials used to define the content of the courses are papers and books; learning management systems are most often used to share materials with students; key learning practices used are active learning, project-based learning, and problem-based learning; and most instructors assess their students with experimental projects and seminars. Based on such results, we provide and discuss a research agenda to improve teaching of ESE. [Conclusions:] This survey provides results towards planning a research agenda to improve teaching of ESE, thus benefiting instructors, researchers, and practitioners.
KW - Controlled Experiments
KW - Experimentation in Software Engineering
KW - Research Agenda
KW - Survey
KW - Teaching
UR - http://www.scopus.com/inward/record.url?scp=85132441844&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85132441844&partnerID=8YFLogxK
U2 - 10.1145/3530019.3535306
DO - 10.1145/3530019.3535306
M3 - Conference contribution
AN - SCOPUS:85132441844
T3 - ACM International Conference Proceeding Series
SP - 299
EP - 304
BT - Proceedings of the ACM International Conference on Evaluation and Assessment in Software Engineering, EASE 2022
PB - Association for Computing Machinery
T2 - 26th ACM International Conference on Evaluation and Assessment in Software Engineering, EASE 2022
Y2 - 13 June 2022 through 15 June 2022
ER -