PEERS Research Methods Series
PEERS Research Methods Series
 
Print

The AERA-ICPSR Partnership for Expanding Education Research in STEM (PEERS) Data Hub announces the PEERS Research Methods Series a webinar series of research capacity-building workshops that focus on research methods used in STEM education research. 

The PEERS Research Methods Series consists of workshops presented in collaboration with the 11 Institutes in Research Methods funded by the National Science Foundation  directed to NSF’s Building Capacity for STEM Education Research (BCSER) program. Aimed at early- and mid-career researchers and scholars, the capacity-building webinar series features projects that seek to promote research expertise in applications of computational, quantitative, qualitative, and evaluative research methods useful to STEM education researchers and broaden the STEM professional workforce.

Upcoming Workshop(s)

Cutting-Edge Quantitative and Computational Methods for STEM Education Research
February 25, 2021; 1:00pm -3:30pm ET

Register here.

Instructors:

  • Kenneth Frank, Michigan State University
  • Guanglei Hong, University of Chicago
  • Stephen Raudenbush, University of Chicago
  • Yanyan Sheng, University of Chicago
  • Kaitlin Torphy, Michigan State University

Description:

The overall goal of this webinar is to inform participants of a wide range of significant research questions, data structures, and advanced analytic techniques in the context of theory-driven and data-informed rigorous empirical investigations of STEM education, especially concerning under-represented groups. Cutting-edge methods are essential to study student and teacher experiences with STEM education programs developed, implemented, and evaluated in a complex environment that outstrips what can be rendered by conventional statistical techniques. To illustrate major methodological considerations, instructors will use a stylized case that evaluates the potentially differential impacts of curricular innovations representing the Next Generation Scientific Standards (NGSS) on instructional practices, student engagement, and science achievement. Key methodological issues will be discussed in six inter-related modules:

(1) Design: How to select the sample of schools and teachers and whether to adopt an experimental or a quasi-experimental design suitable for causal inference of the effects of the curricular innovation.
(2) Measurement: How to construct theoretically grounded instruments with strong psychometric properties to measure student engagement, student learning, teacher practices, etc.
(3) Social network analysis: How to represent and model teachers’ interactions with one another as they adapt and implement the new curriculum.
(4) Multilevel modeling: How to represent and model the student, teacher, and school level factors that affect the implementation and outcomes of the curriculum.
(5) Causal mediation analysis: How to examine instructional practices as a mediator of the effects of the curriculum on student outcomes.
(6) Computational methods: How to account for teachers’ and students’ engagement with one another and educational resources on-line.

Each module will consist of a 10-20 minute presentation followed by 5 minutes of Q&A. Some of the instructors will remain after the session for further conversation. Participants are encouraged to visit https://voices.uchicago.edu/nsf-siarm/ for information about a 3-year training initiative led by the team of instructors.

Past Workshop(s)

Modern Meta-Analysis Research
February 10, 2021; 1:00pm -3:30pm ET

Instructors:

  • Terri Pigott, Georgia State University
  • Joshua Polanin, American Institutes for Research
  • Ryan Williams, American Institutes for Research

Description:

In this workshop, instructors will introduce participants to basic principles of meta-analysis in the context of systematic reviews for STEM education. The instructors will provide a brief overview of the steps of a systematic review using examples from published STEM education meta-analyses. The workshop will focus on best practice methods for meta-analysis, the synthesis of results from quantitative studies. Instructors will introduce effect sizes typically used in STEM systematic reviews including the standardized mean difference and correlations. Participants will practice extracting information needed for effect sizes from STEM research studies. Instructors will use the R program, metafor, for computing effect sizes. Instructors will also introduce basic meta-analysis techniques for estimating the mean effect size from a set of studies and for exploring effect size heterogeneity across studies. Participants will use metafor to compute the mean effect size and its heterogeneity across a set of studies. The workshop will use small data sets derived from published STEM education meta-analyses to demonstrate the method.


The PEERS Data Hub is joint effort of AERA and the Inter-University Consortium for Political and Social Research (ICPSR) that is NSF funded (Award ECR 1937612). It provides collaborative space for STEM education research communities to build and advance knowledge by sharing innovative ideas, methods, and tools. Further information about the PEERS Data Hub is available here.

 
Designed by Weber-Shandwick   Powered by eNOAH