Please use this identifier to cite or link to this item: https://hdl.handle.net/10419/234461 
Year of Publication: 
2021
Series/Report no.: 
SOEPpapers on Multidisciplinary Panel Data Research No. 1135
Publisher: 
Deutsches Institut für Wirtschaftsforschung (DIW), Berlin
Abstract: 
In this article, we present an automated test procedure for examining the filter structure and instructions implemented in electronic questionnaires, and for checking the fit of a questionnaire to the targeted sample. With our approach, we can represent and describe questionnaires using mathematical graphs and specify questionnaire properties in a formal and standardised way. It also allows us deriving mathematical graphs from empirical data. We can then compare the questionnaires (mathematical graphs) with the survey data in an automatable process. Our procedure also includes a test plan we developed for automatic testing. Our approach is complete, portable, and scalable: It is complete in that graphs are used to describe the questionnaires and questionnaire data. It is portable as a result of its generic structure, which is not limited to a specific questionnaire (type), and the provision of free, extensible open-source software. It is scalable through the use of a modular test structure and efficient, up-to-date graph representation and manipulation and display algorithms. We illustrate the functionality and broad applicability of our approach using a hypothetical example and two real examples from two large well-established survey studies (the German National Educational Panel Study, NEPS, and the German Socio-Economic Panel, SOEP).
Subjects: 
questionnaire testing
mathematical graphs
automated test procedure
large-scale survey
Document Type: 
Working Paper

Files in This Item:
File
Size





Items in EconStor are protected by copyright, with all rights reserved, unless otherwise indicated.