AERA Online Paper Repository Viewer

Continuing Paper Access to AERA Annual Meetings
and other Conventions

  
InformationContents
Owner: Lei Wang
Owner Email: lwang8@aum.edu
Paper Title: Construct Validation of a Learning Resources Rubric: A Modified Delphi Study
Session Title: Test Validity Research and Evaluation (Table 34)
Paper Type: Roundtable Presentation
Presentation Date: 4/11/2024
Presentation Location: Philadelphia, Pennsylvania
Descriptors: Instructional Design/Development, Mixed Methods, Validity/Reliability
Methodology: Mixed Method
Author(s): Lei Wang, Fort Hays State University; Tiffany A. Koszalka, Syracuse University
Unit: SIG-Test Validity Research and Evaluation
Abstract: This paper delivers a comprehensive exploration of the construct validation of the LRR, employing a Modified Delphi study coupled with Confirmatory Factor Analysis and Structural Equation Modeling to analyze data. Through rigorous analysis involving 576 expert instructional designers, the study achieves consensus on the LRR’s multifaceted indicators, evidenced by high I-CVI values, confirming their relevance, appropriateness, and robustness The combination of quantitative and qualitative data, including surveys, focus groups, and online document analysis, establishes the rubric’s validity and points to areas for refinement. Grounded in alignment with deeper learning theories and the RIDLR working group’s mission, this study solidifies the LRR as a crucial tool for assessing learning resources, offering significant insights for both theoretical understanding and practical application.
DOI: https://doi.org/10.3102/2114891