Online Archive of University of Virginia Scholarship
Quasi-Experimental Evaluations with Multi-Item Outcomes: Potential Problems and Solutions427 views
Author
Talbert, Eli, Education - School of Education and Human Development, University of Virginia0000-0003-2052-2917
Advisors
Wong, Vivian, ED-EDLF Department, University of Virginia
Soland, Jim, University of Virginia
Abstract
This dissertation seeks to investigate measurement problems related to using multi-item measures in two classes of quasi-experimental designs. It features three chapters with each chapter functioning as an independent paper. The first paper focuses on the Difference-in-Difference design and uses simulation to outline the possible effects of sum scoring and measurement invariance when using survey scale like measures. The second paper shows how this works empirically by rescoring an already completed paper with different Item Response Theory methods and showcasing the resultant differences. Finally, the third paper investigates the viability of using a measurement model to integrate information from multiple raters in Regression Discontinuity designs. Together the three papers help improve the rigor of quasi-experimental evaluations by integrating advances in measurement with those in causal inference.
Degree
PHD (Doctor of Philosophy)
Keywords
quasi-experimental; program evaluation; measurement; causal inference; methods
Talbert, Eli. Quasi-Experimental Evaluations with Multi-Item Outcomes: Potential Problems and Solutions. University of Virginia, Education - School of Education and Human Development, PHD (Doctor of Philosophy), 2023-04-27, https://doi.org/10.18130/e2f8-1j92.
