AERA Online Paper Repository Viewer

Continuing Paper Access to AERA Annual Meetings
and other Conventions

  
InformationContents
Owner: Melissa Dan Wang
Owner Email: wdsghhz@126.com
Paper Title: Automated and Interactive Game-Based Assessment of Critical Thinking
Session Title: Assessment and Technology
Paper Type: Paper
Presentation Date: 4/23/2022
Presentation Location: San Diego, California
Descriptors: Computerized Testing, Critical Thinking, Video Games
Methodology: Mixed Method
Author(s): Dan Wang, The Chinese University of Hong Kong; Hongyun Liu, Beijing Normal University; Leifeng XIAO, The Chinese University of Hong Kong; Luyang Guo, The Chinese University of Hong Kong; Kit-Tai Hau, Chinese University of Hong Kong
Unit: Division C - Learning and Instruction
Abstract: We developed an automated and interactive game-based assessment of critical thinking, the Noah Kingdom, to measure students’ critical thinking ability in solving authentic problems. It was based on the Toulmin Model and used rich game tasks to trigger students' critical thinking. The assessment was repeated over two situational stories. We examined the psychometric quality (concurrent validity with a popular critical thinking test; reliabilities), relations to school academic performance, and students’ perception (e.g., interest, engagement) of Noah Kingdom with 187 Chinese senior secondary students. Results showed that the internal consistency Cronbach’s α (.461 to .839) was reasonable, its concurrent validity (.400 with HCTA) was comparable to those in other similar studies, and students found the game assessment interesting and engaging.
DOI: https://doi.org/10.3102/1882134