AERA Online Paper Repository Viewer

Continuing Paper Access to AERA Annual Meetings
and other Conventions

  
InformationContents
Owner: Denis Dumas
Owner Email: denis.dumas@uga.edu
Paper Title: How Fair Is My Test? A Ratio Coefficient to Help Represent Consequential Validity (Poster 32)
Session Title: Research in Test Validity
Paper Type: Poster Presentation
Presentation Date: 4/16/2023
Presentation Location: Chicago, IL
Descriptors: Social Justice, Testing, Validity/Reliability
Methodology: Quantitative
Author(s): Denis Dumas, University of Georgia; Yixiao Dong, University of Denver; Daniel McNeish, Arizona State University
Unit: SIG-Test Validity Research and Evaluation
Abstract: The degree to which test scores can support justified and fair decisions about demographically diverse participants has been an important aspect of educational and psychological testing. Here, we formulate a relatively simple-to-calculate ratio coefficient that is meant to capture how well the scores from a given test can predict a criterion free from the undue influence of student demographics. We posit three example calculations of this Consequential Validity Ratio (CVR): one where the CVR is quite strong, another where the CVR is more moderate, and a third where the CVR is weak.
DOI: https://doi.org/10.3102/2002351