TY - JOUR
T1 - Validity inquiry process
T2 - Practical guidance for examining performance assessments and building a validity argument
AU - Conn, Cynthia A.
AU - Bohan, Kathy J.
AU - Pieper, Suzanne L.
AU - Musumeci, Matteo
N1 - Publisher Copyright:
© 2020
PY - 2020/6
Y1 - 2020/6
N2 - Given the increased use of performance assessments (PAs) in higher education to evaluate achievement of learning outcomes, it is important to address the barriers related to ensuring quality for this type of assessment. This article presents a design-based research (DBR) study that resulted in the development of a Validity Inquiry Process (VIP). The study's aim was to support faculty in examining the validity and reliability of the interpretation and use of results from locally developed PAs. DBR was determined to be an appropriate method because it is used to study interventions such as an instructional innovation, type of assessment, technology integration, or administrative activity (Anderson & Shattuck, 2012). The VIP provides a collection of instruments and utilizes a reflective practice approach integrating concepts of quality criteria and development of a validity argument as outlined in the literature (M.T. Kane, 2013; Linn, Baker, & Dunbar, 1991; Messick, 1994).
AB - Given the increased use of performance assessments (PAs) in higher education to evaluate achievement of learning outcomes, it is important to address the barriers related to ensuring quality for this type of assessment. This article presents a design-based research (DBR) study that resulted in the development of a Validity Inquiry Process (VIP). The study's aim was to support faculty in examining the validity and reliability of the interpretation and use of results from locally developed PAs. DBR was determined to be an appropriate method because it is used to study interventions such as an instructional innovation, type of assessment, technology integration, or administrative activity (Anderson & Shattuck, 2012). The VIP provides a collection of instruments and utilizes a reflective practice approach integrating concepts of quality criteria and development of a validity argument as outlined in the literature (M.T. Kane, 2013; Linn, Baker, & Dunbar, 1991; Messick, 1994).
KW - Design-based research
KW - Examining validity
KW - Performance assessment
KW - Validity argument
KW - Validity inquiry instruments
UR - http://www.scopus.com/inward/record.url?scp=85079121251&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85079121251&partnerID=8YFLogxK
U2 - 10.1016/j.stueduc.2020.100843
DO - 10.1016/j.stueduc.2020.100843
M3 - Article
AN - SCOPUS:85079121251
SN - 0191-491X
VL - 65
JO - Studies in Educational Evaluation
JF - Studies in Educational Evaluation
M1 - 100843
ER -