Please use this identifier to cite or link to this item: https://hdl.handle.net/10419/236427 
Year of Publication: 
2021
Series/Report no.: 
IZA Discussion Papers No. 14396
Publisher: 
Institute of Labor Economics (IZA), Bonn
Abstract: 
We document the extent, nature, and consequences of survey errors for receipt of cash welfare and SNAP in three major U.S. household surveys linked to administrative program records. Our results confirm high rates of misreporting of program receipt, particularly failure to report receipt. The surveys inaccurately capture patterns of participation in multiple programs, even though there is little evidence of program confusion. Error rates are higher among imputed observations, which also account for a large share of false positive errors. Many household characteristics have significant effects on errors in reporting receipt, both false positives and false negatives. We find large differences in survey errors by race, ethnicity, income and other household characteristics. We provide evidence on the consequences of these errors for models of program receipt. Estimated effects of income and race are noticeably biased. We then examine error due to item non-response and imputation, as well as whether imputation improves estimates. Item non-respondents have higher receipt rates than the population, even conditional on many covariates. The assumptions for consistent estimates in multivariate models fail both when excluding item non-respondents and when using the imputed values. In binary choice models of program receipt, estimates from the linked data favor excluding item non-respondents rather than using their imputed values. The biases in each case are well predicted by the error patterns we document, so such analyses can help researchers make more informed decisions on the use of imputed values.
Subjects: 
linked survey data
measurement error
item non-response
imputation
program receipt
JEL: 
C81
D31
I32
I38
Document Type: 
Working Paper

Files in This Item:
File
Size
679.07 kB





Items in EconStor are protected by copyright, with all rights reserved, unless otherwise indicated.