Data vs. Methods: Quasi-Experimental Evaluation of Alternative Sample Selection Corrections for Missing College Entrance Exam Score Data

dc.contributor.author

Garlick, RJ

dc.contributor.author

Hyman, J

dc.date.accessioned

2016-12-07T15:50:07Z

dc.date.available

2016-12-07T15:50:07Z

dc.date.issued

2016-06-07

dc.description.abstract

In 2007, Michigan began requiring all high school students to take the ACT college entrance exam. This natural experiment allows us to evaluate the performance of several parametric and semiparametric sample selection correction models. We apply each model to the censored, prepolicy test score data and compare the predicted values to the uncensored, post-policy distribution. We vary the set of model predictors to imitate the varying levels of data detail to which a researcher may have access. We find that predictive performance is sensitive to predictor choice but not correction model choice. All models perform poorly using student demographics and school- and district-level characteristics as predictors. However, all models perform well when including students’ prior and contemporaneous scores on other tests. Similarly, correction models using group-level data perform better with more finely disaggregated groups, but produce similar predictions under different functional form assumptions. Our findings are not explained by an absence of selection, the assumptions of the parametric models holding, or the data lacking sufficient variation to permit useful semiparametric estimation. We conclude that “data beat methods” in this setting: gains from using less restrictive econometric methods are small relative to gains from seeking richer or more disaggregated data.

dc.format.extent

96 pages

dc.identifier.uri

https://hdl.handle.net/10161/13249

dc.relation.ispartof

Economic Research Initiatives at Duke (ERID)

dc.title

Data vs. Methods: Quasi-Experimental Evaluation of Alternative Sample Selection Corrections for Missing College Entrance Exam Score Data

dc.type

Journal article

pubs.issue

221

pubs.organisational-group

Duke

pubs.organisational-group

Duke Population Research Center

pubs.organisational-group

Duke Population Research Institute

pubs.organisational-group

Economics

pubs.organisational-group

Sanford School of Public Policy

pubs.organisational-group

Trinity College of Arts & Sciences

Files

Original bundle

Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
SSRN-id2793486.pdf
Size:
1.09 MB
Format:
Adobe Portable Document Format